8

Click here to load reader

Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Embed Size (px)

DESCRIPTION

Astro-WISE workshop, 31/03 – 03/ Kor Begeman USNO A2.0, # (100%)‏ SDSS PhotoObjAll-DR5, # (29%)‏ SDSS Photoz-DR5, # (29%)‏ SDSS SpecObjAll-DR5, # (19%)‏ UKIDSS lasSource-DR3, # (85%)‏ 2MASS PSC, # (0%)‏ 2MASS XSC, # (0%)‏ External SourceLists

Citation preview

Page 1: Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Astro-WISE workshop, 31/03 – 03/04 2008 1 Kor Begeman

SourceLists & AssociateLists

Parallel Tables

External SourceLists

CombinedLists

SourceLinks

New Developments / Problems

Page 2: Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Astro-WISE workshop, 31/03 – 03/04 2008 2 Kor Begeman

Oracle Table limit < 1000 columns

Better for external SourceLists

Easier for DB tuning and table statistics

Space saving on other nodes (DB links)

Parallel Tables

Page 3: Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Astro-WISE workshop, 31/03 – 03/04 2008 3 Kor Begeman

USNO A2.0, # 526.280.881 (100%)

SDSS PhotoObjAll-DR5, # 354.254.163 (29%)

SDSS Photoz-DR5, # 354.188.961 (29%)

SDSS SpecObjAll-DR5, # 1.048.960 (19%)

UKIDSS lasSource-DR3, # 36.250.945 (85%)

2MASS PSC, # 470.992.970 (0%)

2MASS XSC, # 1.647.599 (0%)

External SourceLists

Page 4: Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Astro-WISE workshop, 31/03 – 03/04 2008 4 Kor Begeman

Not a Class, but a set of functions

All operations on DataBase level

AssociateList Single Source Catalogue

AID SID

filters='MAG_1:#849,MAG_2:#850'

CombinedList

Page 5: Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Astro-WISE workshop, 31/03 – 03/04 2008 5 Kor Begeman

CombinedList

Page 6: Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Astro-WISE workshop, 31/03 – 03/04 2008 6 Kor Begeman

CombinedList

Estimation: 100.000.000 sources in 4 daysby 100,000 chunks

Page 7: Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Astro-WISE workshop, 31/03 – 03/04 2008 7 Kor Begeman

Required for Individual Source Processing (i.e. for Galfit, Galphot)

Provides a pointer to a Source in a SourceList

SourceLink

Page 8: Astro-WISE workshop, 31/03 – 03/04 20081Kor Begeman SourceLists & AssociateLists Parallel Tables External SourceLists CombinedLists SourceLinks New Developments

Astro-WISE workshop, 31/03 – 03/04 2008 8 Kor Begeman

New Developments / Problems

Associate Large SourceLists

Maximum number of SourceLists to Associate should be increased

Problems with HTM software

Mosaic AssociateList

Combine AssociateLists

Import/Export SL from/to XML