Jump to content

XLDB: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
GreenC bot (talk | contribs)
Rescued 2 archive links; reformat 2 links. Wayback Medic 2.1
Elharo (talk | contribs)
m past tense
 
(16 intermediate revisions by 9 users not shown)
Line 1: Line 1:
'''XLDB''' (eXtremely Large [[Database|Data Bases]]) is a yearly conference about data processing. The definition of ''extremely large'' refers to data sets that are too big in terms of volume (too much), and/or velocity (too fast), and/of variety (too many places, too many formats) to be handled using conventional solutions.
'''XLDB''' (e'''X'''tremely '''L'''arge '''D'''ata'''B'''ases) was a yearly conference about [[database]]s, [[data management]] and [[analytics]] held from 2007 to 2019. The definition of ''extremely large'' refers to data sets that are too big in terms of volume (too much), and/or velocity (too fast), and/or variety (too many places, too many formats) to be handled using conventional solutions. This conference dealt with the high-end of [[very large database]]s (VLDB). It was conceived and chaired by Jacek Becla.


== History ==
== History ==


In October 2007 the XLDB experts gathered at [[SLAC]] for the [https://web.archive.org/web/20080417002612/http://www-conf.slac.stanford.edu/xldb07/ First Workshop on Extremely Large Databases]. As a result, the XLDB research community was formed. to meet rapidly growing demands, in addition to the original invitational workshop, an open conference, tutorials, and annual satellite events on different continents were added. The main event, held annually at Stanford gathers over 300 technically savvy attendees. XLDB is one of the premier database events catered towards both academic and industrial communities.
In October 2007, data experts gathered at [[SLAC|SLAC National Accelerator Lab]] for the [https://web.archive.org/web/20080417002612/http://www-conf.slac.stanford.edu/xldb07/ First Workshop on Extremely Large Databases]. As a result, the XLDB research community was formed to meet the rapidly growing demands of the largest data systems. In addition to the original invitational workshop, an open conference, tutorials, and annual satellite events on different continents were added. The main event, held annually at [[Stanford University]] gathers over 300 attendees. XLDB is one of the data systems events catering to both academic and industry communities. For 2009, the workshop was co-located with [[VLDB conference|VLDB 2009]] in France to reach out to non-US research communities.<ref>{{Cite web|url=https://www.symmetrymagazine.org/breaking/2009/09/16/building-the-biggest-scientific-databases|title=Building the biggest scientific databases|website=symmetry magazine|language=en|access-date=2019-04-15}}</ref> XLDB 2019 followed Stanford's Conference on Systems and Machine Learning (SysML).<ref>{{Cite web|url=https://conf.slac.stanford.edu/xldb2019/|title=XLDB Extremely Large Databases 2019|website=XLDB Extremely Large Databases 2019|access-date=2019-04-15}}</ref>


== Goals ==
== Goals ==


The main goals of this community include:<ref>{{ cite web | url=http://www-conf.slac.stanford.edu/xldb09/docs/xldb09_welcomeTalk.ppt | year=2009 | last=Becla| first=Jacek | title=XLDB 3 Welcome | accessdate=2009-08-29 }}</ref>
The main goals of this community include:<ref>{{ cite web | url=http://www-conf.slac.stanford.edu/xldb09/docs/xldb09_welcomeTalk.ppt | year=2009 | last=Becla| first=Jacek | title=XLDB 3 Welcome | access-date=2009-08-29 }}</ref>


* Identify trends, commonalities and major roadblocks related to building extremely large databases
* Identify trends, commonalities and major roadblocks related to building extremely large databases
Line 14: Line 14:


== XLDB Community ==
== XLDB Community ==
As of 2013, the community consisted of about a thousand members including:
As of 2013, the community consisted of over one thousand members including:
# Scientists who develop, use, or plan to develop or use XLDB for their research, from laboratories.
# Scientists who develop, use, or plan to develop or use XLDB for their research, from laboratories.
# Commercial users of XLDB.
# Commercial users of XLDB.
Line 21: Line 21:


== XLDB Conferences, Workshops and Tutorials ==
== XLDB Conferences, Workshops and Tutorials ==
The community meets annually at [[Stanford]] where the main event is held each fall, usually in September. These who live too far from California to attend have the opportunity to attend satellite events, organized annually around May/June either in [[Asia]] or in [[Europe]].
The community met annually at [[Stanford University]] through 2019. Occasional satellite events were held in [[Asia]] and [[Europe]].


A detailed report is produced after each workshop.
A detailed report or videos was produced after each workshop.


{| class="wikitable"
{| class="wikitable"
Line 32: Line 32:
! Report
! Report
! Comments
! Comments
|-
| 2019
| [[Stanford]]
| [https://conf.slac.stanford.edu/xldb2019/]
|
| 12th XLDB Conference
|-
| 2018
| [[Stanford]]
| [https://conf.slac.stanford.edu/xldb2018/]
|
| 11th XLDB Conference
|-
|-
| 2017
| 2017
Line 71: Line 83:
| 2013
| 2013
| [[CERN]], [[Geneva]]/[[Switzerland]]
| [[CERN]], [[Geneva]]/[[Switzerland]]
| [https://archive.is/20130410033807/http://xldb-europe-workshop-2013.web.cern.ch/]
| [https://archive.today/20130410033807/http://xldb-europe-workshop-2013.web.cern.ch/]
|
|
| Satellite XLDB Workshop in Europe
| Satellite XLDB Workshop in Europe
Line 90: Line 102:
| [[SLAC]]
| [[SLAC]]
| [https://web.archive.org/web/20110426125951/http://www-conf.slac.stanford.edu/xldb2011/]
| [https://web.archive.org/web/20110426125951/http://www-conf.slac.stanford.edu/xldb2011/]
| [http://www.jstage.jst.go.jp/article/dsj/11/0/37/_pdf]{{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}
| [https://www.jstage.jst.go.jp/article/dsj/11/0/11_012-010/_pdf]
| 5th XLDB Conference and Workshop
| 5th XLDB Conference and Workshop
|-
|-
Line 102: Line 114:
| [[SLAC]]
| [[SLAC]]
| [https://web.archive.org/web/20110727234052/http://www-conf.slac.stanford.edu/xldb2010/]
| [https://web.archive.org/web/20110727234052/http://www-conf.slac.stanford.edu/xldb2010/]
| [http://www.jstage.jst.go.jp/article/dsj/9/0/9_MR1/_article]{{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}
| [https://www.jstage.jst.go.jp/article/dsj/9/0/9_xldb10/_pdf]
| 4th XLDB Conference and Workshop
| 4th XLDB Conference and Workshop
|-
|-
Line 108: Line 120:
| [[Lyon]], [[France]]
| [[Lyon]], [[France]]
| [https://web.archive.org/web/20110727234623/http://www-conf.slac.stanford.edu/xldb2009/]
| [https://web.archive.org/web/20110727234623/http://www-conf.slac.stanford.edu/xldb2009/]
| [http://www.jstage.jst.go.jp/article/dsj/8/0/MR1/_pdf]{{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}
| [https://www.jstage.jst.go.jp/article/dsj/8/0/8_xldb09/_pdf]
| 3rd XLDB Workshop
| 3rd XLDB Workshop
|-
|-
Line 114: Line 126:
| [[SLAC]]
| [[SLAC]]
| [https://web.archive.org/web/20110727234818/http://www-conf.slac.stanford.edu/xldb2008/]
| [https://web.archive.org/web/20110727234818/http://www-conf.slac.stanford.edu/xldb2008/]
| [http://www.jstage.jst.go.jp/article/dsj/7/0/196/_pdf]{{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}
| [https://www.jstage.jst.go.jp/article/dsj/7/0/7_7-196/_pdf]
| 2nd XLDB Workshop
| 2nd XLDB Workshop
|-
|-
Line 120: Line 132:
| [[SLAC]]
| [[SLAC]]
| [https://web.archive.org/web/20110727235121/http://www-conf.slac.stanford.edu/xldb2007/]
| [https://web.archive.org/web/20110727235121/http://www-conf.slac.stanford.edu/xldb2007/]
| [http://www.jstage.jst.go.jp/article/dsj/7/0/1/_pdf]{{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}
| [https://www.jstage.jst.go.jp/article/dsj/7/0/7_becla0223/_pdf]
| 1st XLDB Workshop
| 1st XLDB Workshop
|}
|}
Line 126: Line 138:
== Tangible results ==
== Tangible results ==


The XLDB events led to initiating the effort of building a new open source, science database, [https://web.archive.org/web/20090220121225/http://scidb.org/ SciDB].<ref>{{ cite web | url=http://www.jstage.jst.go.jp/article/dsj/7/0/88/_pdf | year=2008 | last=Becla| first=Jacek | title=Report from the SciDB Workshop |accessdate=2008-09-29}}{{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}</ref>
XLDB events led to initiating an effort to build a new open source, science database called [https://web.archive.org/web/20090220121225/http://scidb.org/ SciDB].<ref>{{ cite web | url=http://www.jstage.jst.go.jp/article/dsj/7/0/88/_pdf | year=2008 | last=Becla| first=Jacek | title=Report from the SciDB Workshop |access-date=2008-09-29}}{{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}</ref>


The XLDB organizers started defining a [http://www.xldb.org/science-benchmark/ science benchmark] for scientific data management systems called SS-DB.
The XLDB organizers started defining a [http://www.xldb.org/science-benchmark/ science benchmark] for scientific data management systems called SS-DB.


At [https://archive.is/20130416124054/http://xldb.org/2012 |XLDB 2012] the XLDB organizers announced that two major databases that support arrays as first-class objects ([[MonetDB]] SciQL and [[SciDB]]) have formed a working group in conjunction with XLDB. This working group is proposing a common syntax (provisionally named “ArrayQL”) for manipulating arrays, including array creation and query.
At [https://archive.today/20130416124054/http://xldb.org/2012 XLDB 2012] the XLDB organizers announced that two major databases that support arrays as [[First-class citizen|first-class objects]] ([[MonetDB]] SciQL and [[SciDB]]) have formed a working group in conjunction with XLDB. This working group is proposing a common syntax (provisionally named “ArrayQL”) for manipulating arrays, including array creation and query.

== See also ==
*[[International Conference on Very Large Data Bases]]


== References ==
== References ==
Line 137: Line 152:
== Further reading ==
== Further reading ==
* Pavlo A., Paulson E., Rasin A., Abadi D. J., Dewitt D. J., Madden S., and Stonebraker M., ''A Comparison of Approaches to Large-Scale Data Analysis," Proceedings of the 2009 ACM SIGMOD, https://web.archive.org/web/20090611174944/http://database.cs.brown.edu/sigmod09/benchmarks-sigmod09.pdf
* Pavlo A., Paulson E., Rasin A., Abadi D. J., Dewitt D. J., Madden S., and Stonebraker M., ''A Comparison of Approaches to Large-Scale Data Analysis," Proceedings of the 2009 ACM SIGMOD, https://web.archive.org/web/20090611174944/http://database.cs.brown.edu/sigmod09/benchmarks-sigmod09.pdf
* {{cite book |doi=10.1117/12.671721|chapter=Designing a multi-petabyte database for LSST|title=Observatory Operations: Strategies, Processes, and Systems|year=2006|editor1-last=Silva|editor1-first=David R|last1=Becla|first1=Jacek|last2=Hanushevsky|first2=Andrew|last3=Nikolaev|first3=Sergei|last4=Abdulla|first4=Ghaleb|last5=Szalay|first5=Alex|last6=Nieto-Santisteban|first6=Maria|last7=Thakar|first7=Ani|last8=Gray|first8=Jim|s2cid=3204824|volume=6270|pages=62700R|editor2-first=Rodger E|editor2-last=Doxsey |arxiv=cs/0604112 }}
* Becla, J., et al. 2006, ''Designing a multi-petabyte database for LSST,'' https://arxiv.org/abs/cs/0604112
* Becla, J., & Wang, D. L. 2005, ''Lessons Learned from Managing a Petabyte'', downloaded from https://web.archive.org/web/20110604223735/http://www.slac.stanford.edu/pubs/slacpubs/10750/slac-pub-10963.pdf on 2007-11-25.
* Becla, J., & Wang, D. L. 2005, ''Lessons Learned from Managing a Petabyte'', downloaded from https://web.archive.org/web/20110604223735/http://www.slac.stanford.edu/pubs/slacpubs/10750/slac-pub-10963.pdf on 2007-11-25.
* Bell, G., Gray, J., & Szalay, A. 2005, ''Petascale computations systems: Balanced cyberinfrastructure in a data-centric world,'' https://arxiv.org/abs/cs/0701165
* {{cite journal |last1=Bell |first1=Gordon |last2=Gray |first2=Jim |last3=Szalay |first3=Alex |title=Petascale Computational Systems |year=2007 |bibcode=2007cs........1165B |arxiv=cs/0701165 }}
* Duellmann, D. 1999, ''Petabyte Databases'', ACM SIGMOD Record, vol. 28, p. 506, https://web.archive.org/web/20071012015357/http://www.sigmod.org/sigmod/record/issues/9906/index.html#TutorialSessions.
* Duellmann, D. 1999, ''Petabyte Databases'', ACM SIGMOD Record, vol. 28, p. 506, https://web.archive.org/web/20071012015357/http://www.sigmod.org/sigmod/record/issues/9906/index.html#TutorialSessions.
* Hanushevsky, A., & Nowak, M. 1999, ''Pursuit of a Scalable High Performance Multi-Petabyte Database'', 16th IEEE Symposium on Mass Storage Systems, pp. 169–175, http://citeseer.ist.psu.edu/217883.html.
* Hanushevsky, A., & Nowak, M. 1999, ''Pursuit of a Scalable High Performance Multi-Petabyte Database'', 16th IEEE Symposium on Mass Storage Systems, pp. 169–175, http://citeseer.ist.psu.edu/217883.html.
* Shiers, J., ''Building Very Large, Distributed Object Databases'', downloaded from https://web.archive.org/web/20070915101842/http://wwwasd.web.cern.ch/wwwasd/cernlib/rd45/papers/dbprog.html on 2007-11-25.
* Shiers, J., ''Building Very Large, Distributed Object Databases'', downloaded from https://web.archive.org/web/20070915101842/http://wwwasd.web.cern.ch/wwwasd/cernlib/rd45/papers/dbprog.html on 2007-11-25.


== External links ==
* [https://www.xldb.org Official website]
* {{YouTube|u=XLDBConf| XLDBConf }}

[[Category:Computer science conferences]]
[[Category:Types of databases]]
[[Category:Types of databases]]
[[Category:Data management]]
[[Category:Data management]]

Latest revision as of 12:55, 21 May 2024

XLDB (eXtremely Large DataBases) was a yearly conference about databases, data management and analytics held from 2007 to 2019. The definition of extremely large refers to data sets that are too big in terms of volume (too much), and/or velocity (too fast), and/or variety (too many places, too many formats) to be handled using conventional solutions. This conference dealt with the high-end of very large databases (VLDB). It was conceived and chaired by Jacek Becla.

History

[edit]

In October 2007, data experts gathered at SLAC National Accelerator Lab for the First Workshop on Extremely Large Databases. As a result, the XLDB research community was formed to meet the rapidly growing demands of the largest data systems. In addition to the original invitational workshop, an open conference, tutorials, and annual satellite events on different continents were added. The main event, held annually at Stanford University gathers over 300 attendees. XLDB is one of the data systems events catering to both academic and industry communities. For 2009, the workshop was co-located with VLDB 2009 in France to reach out to non-US research communities.[1] XLDB 2019 followed Stanford's Conference on Systems and Machine Learning (SysML).[2]

Goals

[edit]

The main goals of this community include:[3]

  • Identify trends, commonalities and major roadblocks related to building extremely large databases
  • Bridge the gap between users trying to build extremely large databases and database solution providers worldwide
  • Facilitate development and growth of practical technologies for extremely large data stores

XLDB Community

[edit]

As of 2013, the community consisted of over one thousand members including:

  1. Scientists who develop, use, or plan to develop or use XLDB for their research, from laboratories.
  2. Commercial users of XLDB.
  3. Providers of database products, including commercial vendors and representatives from open source database communities.
  4. Academic database researchers.

XLDB Conferences, Workshops and Tutorials

[edit]

The community met annually at Stanford University through 2019. Occasional satellite events were held in Asia and Europe.

A detailed report or videos was produced after each workshop.

Year Place Link Bericht Kommentare
2019 Stanford [1] 12th XLDB Conference
2018 Stanford [2] 11th XLDB Conference
2017 Clermont-Ferrand [3] 10th XLDB Conference
2016 Stanford [4] 9th XLDB Conference
2015 Stanford [5] 8th XLDB Conference
2014 Observatório Nacional, Rio_de_Janeiro [6] Satellite XLDB Workshop in South America
2014 Stony_Brook_University [7] XLDB-Healthcare Workshop
2013 Stanford [8] 7th XLDB Conference
2013 CERN, Geneva/Switzerland [9] Satellite XLDB Workshop in Europe
2012 Stanford [10] [11] 6th XLDB Conference, Workshop & Tutorials
2012 Beijing, China [12] [13] Satellite XLDB Conference in Asia
2011 SLAC [14] [15] 5th XLDB Conference and Workshop
2011 Edinburgh, UK [16] not available Satellite XLDB Workshop in Europe
2010 SLAC [17] [18] 4th XLDB Conference and Workshop
2009 Lyon, France [19] [20] 3rd XLDB Workshop
2008 SLAC [21] [22] 2nd XLDB Workshop
2007 SLAC [23] [24] 1st XLDB Workshop

Tangible results

[edit]

XLDB events led to initiating an effort to build a new open source, science database called SciDB.[4]

The XLDB organizers started defining a science benchmark for scientific data management systems called SS-DB.

At XLDB 2012 the XLDB organizers announced that two major databases that support arrays as first-class objects (MonetDB SciQL and SciDB) have formed a working group in conjunction with XLDB. This working group is proposing a common syntax (provisionally named “ArrayQL”) for manipulating arrays, including array creation and query.

See also

[edit]

References

[edit]
  1. ^ "Building the biggest scientific databases". symmetry magazine. Retrieved 2019-04-15.
  2. ^ "XLDB Extremely Large Databases 2019". XLDB Extremely Large Databases 2019. Retrieved 2019-04-15.
  3. ^ Becla, Jacek (2009). "XLDB 3 Welcome". Retrieved 2009-08-29.
  4. ^ Becla, Jacek (2008). "Report from the SciDB Workshop". Retrieved 2008-09-29.[permanent dead link]

Further reading

[edit]
[edit]