Content deleted Content added
m Typos |
#suggestededit-add 1.0 Tags: Mobile edit Mobile app edit Android app edit |
||
| (8 intermediate revisions by 8 users not shown) | |||
Line 1:
{{Short description|Open source software suite}}
{{Infobox software
| name = Sector/Sphere
Line 4 ⟶ 5:
| caption = Logo
| developer = The Sector Alliance
| latest release version = 2.8
| latest release date = {{release date|2012|10|08}}
Line 13:
| genre = [[Distributed file system|Distributed File System]]
| license = [[Apache License 2.0]]
| website =
}}
'''Sector/Sphere''' is an [[open source software]] suite for high-performance [[distributed data storage]] and [[Distributed processing|processing]]. It can be broadly compared to [[Google]]'s [[Google File System|GFS]]
The system was created by
==Architecture==
Sector/Sphere consists of four components. The security server maintains the system security policies such as user accounts and the IP access control list. One or more master servers control operations of the overall system in addition to responding to various user requests. The slave nodes store the data files and process them upon request. The clients are the users' computers from which system access and data processing requests are issued. Also, Sector/Sphere is written in [[C++]] and is claimed to achieve with its architecture a two to four times better performance than the competitor [[Hadoop]] which is written in [[Java (software)|Java]],<ref>[http://sector.sourceforge.net/pub/Sector%20vs%20Hadoop%20-%20v1.pdf Sector vs. Hadoop - A Brief Comparison Between the Two Systems]</ref> a statement supported by an [[Aster Data Systems]] [[Benchmark (computing)|benchmark]]<ref name="benchmark">[http://decisionstats.com/2010/09/26/sector-sphere-faster-than-hadoopmapreduce-at-terasort/ Sector/ Sphere – Faster than Hadoop/Mapreduce at Terasort] September 26, 2010 Ajay Ohri</ref> and the winning of the "bandwidth challenge" of the [[Supercomputing Conference]] 2006,<ref>[
[[File:Sector-arch.jpg|thumb|3003px|Architecture of Sector/Sphere with its four components.]]
===Sector
Sector is a user space file system which relies on the local/native file system of each node for storing uploaded files. Sector provides file system-level fault tolerance by replication, thus it does not require hardware fault tolerance such as [[RAID]], which is usually very expensive.
Line 39:
The Sector client provides an [[API]] for application development which allows user applications to interact directly with Sector. The software also comes prepackaged with a set of command-line tools for accessing the file system. Finally, Sector supports the [[Filesystem in Userspace|FUSE]] interface; presenting a mountable file system that is accessible via standard command-line tools.
===Sphere
Sphere is a parallel data processing engine integrated in Sector and it can be used to process data stored in Sector in parallel. It can broadly compared to [[MapReduce]], but it uses generic
▲Benefiting from the underlying Sector file system and the flexibility of the UDF model, Sphere can manipulate the locality of both input data and output data, thus it can effectively support multiple input datasets, combinative and iterative operations and even legacy application executable.
Because Sector does not split user files, Sphere can simply wrap up many existing applications that accepts files or directories as input, without rewriting them. Thus it can provide greater compatibility to legacy applications.{{Citation needed|date=October 2012}}
==See also==
{{Portal|Free and open-source software}}
* [[Pentaho]] - Open source data integration (Kettle), analytics, reporting, visualization and predictive analytics directly from Hadoop nodes
* [[Nutch]] - An effort to build an open source search engine based on [[Lucene]] and Hadoop, also created by Doug Cutting
* [[Apache Accumulo]] - Secure Big Table
* [[HBase]] - [[
* [[Hypertable]] - HBase alternative
* [[MapReduce]] - Hadoop's fundamental data filtering algorithm
Line 63 ⟶ 61:
==Literature==
* Yunhong Gu, Robert Grossman, [http://
==References==
| |||