Commons:Batch uploading/HiRISE
- Source to upload from: https://www.uahirise.org/catalog/
- Do the media URLs follow a pattern? Yes! (Based on the catalog ID)
- Does the site have an API? No!
- What else could ease uploading? (is the site valid XHTML, do they use a WCM…?)
- Full index tree of the images on the site is accessible via:
- With extra files in:
- Each image file *.JP2 (sample [Big file]) accompanies the additional information in a separate label file *.LBL in PDS format (sample)
- Did you contact the site owner? Nope!
- Describe the works to be uploaded in detail (audio files, images by …):
- Images by HiRISE (High Resolution Imaging Science Experiment)
- Which license tag(s) should be applied?
- As explained in each image's description page for example: "All of the images produced by HiRISE and accessible on this site are within the public domain: there are no restrictions on their usage by anyone in the public, including news or science organizations. We do ask for a credit line where possible: NASA/JPL/University of Arizona"
- PD-USGov-NASA or a variation of it to include JPL and University of Arizona must be used.
- Is there a template that could be used on the file description pages? Do you think a special template should be created?
- There is no template yet. It must be created to include all the relevant data e.g. Acquisition date, Latitude , Longitude , etc. from the label files.
- Note: Due to JPEG2000 not being currently supported on Wikimedia Commons, a conversion to PNG is also needed. File sizes may be large!
Meisam (talk) 21:58, 20 June 2018 (UTC)
Opinions
[edit]- Support Seems like an interesting project --Kristbaum (talk) 16:00, 8 May 2019 (UTC)
- Info Template:PD-NASA-HiRISE has been created for these images! -- Meisam (talk) 17:31, 11 May 2019 (UTC)
- @Meisam: - I am interested in pursuing this. I think it would be a logical extension of my work with uploading from ESRS. Do you have any suggestion as to how we most efficiently store the PDS data with each image? Askeuhd (talk) 08:28, 6 June 2022 (UTC)
- @Askeuhd: I don’t have any good solutions. I suppose we can store them as tEXt chunks in the PNG image and also add them in a table (using wiki templates) to the image description page. -- Meisam (talk) 11:30, 6 June 2022 (UTC)
- @Meisam: - I would personally much prefer the latter option, I fear that the former option may not be very user friendly. We will also have to parse as much of the data as possible to SDC. I will try to think of a suitable paradigm. Askeuhd (talk) 11:40, 6 June 2022 (UTC)
- @Askeuhd: I don’t have any good solutions. I suppose we can store them as tEXt chunks in the PNG image and also add them in a table (using wiki templates) to the image description page. -- Meisam (talk) 11:30, 6 June 2022 (UTC)
- @Meisam: - I am interested in pursuing this. I think it would be a logical extension of my work with uploading from ESRS. Do you have any suggestion as to how we most efficiently store the PDS data with each image? Askeuhd (talk) 08:28, 6 June 2022 (UTC)
Assigned to | Progress | Bot name | Category |
---|---|---|---|
PDS data import proposal
[edit]Proposal for the import of PDS data for each image, to ensure as much as possible is added to SDC and necessary data for the user is displayed prominently in the wikitext.
I propose that the entire LBL file is imported as a collapsible text field in the template for each file, preserving all formatting and indentation, so that researches or other users familiar with the PDS format may be able to utilize plain text search for the values we will not be able to add to SDC, similar to this:
Raw Planetary Data System data
|
---|
|
In addition to this, I have broken down the example file, to try and maximize possible SDC data migration, as well as adding some of the data to a custom wikidata template for this particular import. I am highly interested in any suggestions. I take the libery of pinging @Multichill: as you have previously been very helpful in a similar endeavour with the ISS photos. I hope you would be interested in adding your valuable input here as well.
I will make a couple of example files in a few days or so to test the SDC structure and a potential template, before starting any peliminary coding, so the concepts can be tested out.
Reference to be set as stated in (P248) --> "Planetary Data System" for all SDC values imported from PDS.
All PDS identifiers can be looked up here for clarification. The LBL example file also contains some in-line comments.
PDS Identifier | PDS Value in example file | Commons/SDC identifier | Commons/SDC value |
---|---|---|---|
PDS_VERSION_ID | PDS3 | N/A | N/A |
NOT_APPLICABLE_CONSTANT | -9998 | N/A | N/A |
DATA_SET_ID | "MRO-M-HIRISE-3-RDR-V1.1" | N/A | N/A |
DATA_SET_NAME | "MRO MARS HIGH RESOLUTION IMAGING SCIENCE EXPERIMENT RDR V1.1" | part of the series (P179) | Appropriate wikidata-entity for this property (to be created) |
PRODUCER_INSTITUTION_NAME | "UNIVERSITY OF ARIZONA" | affiliation (P1416) as a qualifier to creator (P170) | University of Arizona (Q503419) |
PRODUCER_ID | "UA" | N/A | N/A |
PRODUCER_FULL_NAME | "ALFRED MCEWEN" | creator (P170) | "some value" --> "Alfred McEwen" |
OBSERVATION_ID | "ESP_053850_2170" | catalog code (P528) and {{NASA-image}} | "some value" --> "ESP_053850_2170", qualified with catalog (P972) and an appropriate wikidata-entity for this property (to be created). |
PRODUCT_ID | "ESP_053850_2170_RED" | N/A | N/A |
PRODUCT_VERSION_ID | "1.0" | N/A | N/A |
INSTRUMENT_HOST_NAME | "MARS RECONNAISSANCE ORBITER" | location of creation (P1071) & location of the point of view (P7108) | Mars Reconnaissance Orbiter (Q183160) |
INSTRUMENT_HOST_ID | "MRO" | N/A | N/A |
INSTRUMENT_NAME | "HIGH RESOLUTION IMAGING SCIENCE EXPERIMENT" | captured with (P4082) | HiRISE (Q1036092) |
INSTRUMENT_ID | "HIRISE" | N/A | N/A |
TARGET_NAME | "MARS" | depicts (P180) | Mars (Q111) |
MISSION_PHASE_NAME | "EXTENDED SCIENCE PHASE" | significant event (P793) | Appropriate wikidata-entity for this property (to be created) |
ORBIT_NUMBER | 53850 | orbits completed (P1418) | value: 53850 possibly qualified with type of orbit (P522) --> areocentric orbit (Q3884965) |
SOURCE_PRODUCT_ID | (ESP_053850_2170_RED0_0, ESP_053850_2170_RED0_1, ESP_053850_2170_RED1_0, ESP_053850_2170_RED1_1, ESP_053850_2170_RED2_0, ESP_053850_2170_RED2_1, ESP_053850_2170_RED3_0, ESP_053850_2170_RED3_1, ESP_053850_2170_RED4_0, ESP_053850_2170_RED4_1, ESP_053850_2170_RED5_0, ESP_053850_2170_RED5_1, ESP_053850_2170_RED6_0, ESP_053850_2170_RED6_1, ESP_053850_2170_RED7_0, ESP_053850_2170_RED7_1, ESP_053850_2170_RED8_0, ESP_053850_2170_RED8_1) | N/A | N/A |
RATIONALE_DESC | "Monitoring new impact site" | to be added to {{En}} in main template - We might also go over all LBL files to search for obvious depicts (P180) statements | "PDS description: Monitoring new impact site" |
SOFTWARE_NAME | "PDS_to_JP2 v3.19 (1.53 2012/01/24 03:07:27)" | I was unable to find an appropriate wikidata property here, but I feel like there should be one | ? |
DATA_SET_MAP_PROJECTION | "DSMAP.CAT" | N/A | N/A |
MAP_PROJECTION_TYPE | "EQUIRECTANGULAR" | I was unable to find the appropriate wikidata property for "projection", I might be looking in the wrong place. spatial reference system (P3037) was the closest I got | equidistant cylindrical projection (Q1326965) |
PROJECTION_LATITUDE_TYPE | PLANETOCENTRIC | N/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are planetocentric) | N/A |
A_AXIS_RADIUS | 3389.5743490888 <KM> | N/A (simply the mean readius of Mars) | N/A |
B_AXIS_RADIUS | 3389.5743490888 <KM> | N/A (simply the mean readius of Mars) | N/A |
C_AXIS_RADIUS | 3389.5743490888 <KM> | N/A (simply the mean readius of Mars) | N/A |
COORDINATE_SYSTEM_NAME | PLANETOCENTRIC | N/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are planetocentric) | N/A |
POSITIVE_LONGITUDE_DIRECTION | EAST | N/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are east-positive) | N/A |
KEYWORD_LATITUDE_TYPE | PLANETOCENTRIC | N/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are planetocentric) | N/A |
POSITIVE_LONGITUDE_DIRECTION | EAST | N/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are east-positive) | N/A |
KEYWORD_LATITUDE_TYPE | PLANETOCENTRIC | N/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are planetocentric) | N/A |
CENTER_LATITUDE | 35.000 <DEG> | See below | See below |
CENTER_LONGITUDE | 180.000 <DEG> | coordinates of depicted place (P9149) - not completely sure though, as it the example specifically comments that the location is the center of the projection not necessarily the center of the image. So it may not be so helpful to import this value as the coordinates of depicted place (P9149) - see bounding values below | { "latitude": 35, "longitude": 180, "precision": 0.001, "globe": "http://www.wikidata.org/entity/Q106948918" }
|
LINE_FIRST_PIXEL | 1 | N/A | N/A |
LINE_LAST_PIXEL | 32134 | N/A | N/A |
SAMPLE_FIRST_PIXEL | 1 | N/A | N/A |
SAMPLE_LAST_PIXEL | 25483 | N/A | N/A |
MAP_PROJECTION_ROTATION | 0.0 <DEG> | N/A | N/A |
MAP_RESOLUTION | 236636.93053097 <PIX/DEG> | angular resolution (P3439) | converted to milliarcseconds/pixel (1/236636.93053097*3600000) value: 15.21317907531, unit: milliarcsecond (Q21500224) |
MAP_SCALE | 0.25 <METERS/PIXEL> | I was unable to find an appropriate wikidata property here, something like "ground sample distance" or similar - I think it should be included as custom field in the wikitext template for each image, as it is a very commonly needed figure | N/A |
MAXIMUM_LATITUDE | 36.973920949851 <DEG> | coordinates of northernmost point (P1332) | { "latitude": 36.973920949851, "longitude": 148.23651113052, "precision": 0.000000000001, "globe": "http://www.wikidata.org/entity/Q106948918" } <-- longitude set to westermost longitude clarified by syntax clarification (P2916) qualifier.
|
MINIMUM_LATITUDE | 36.838131126084 <DEG> | coordinates of southernmost point (P1333) | { "latitude": 36.838131126084, "longitude": 148.36797304112, "precision": 0.000000000001, "globe": "http://www.wikidata.org/entity/Q106948918" } <-- longitude set to easternmost longitude clarified by syntax clarification (P2916) qualifier.
|
LINE_PROJECTION_OFFSET | 8749396.5 <PIXEL> | N/A | N/A |
SAMPLE_PROJECTION_OFFSET | 6157087.5 <PIXEL> | N/A | N/A |
EASTERNMOST_LONGITUDE | 148.36797304112 <DEG> | coordinates of easternmost point (P1334) | { "latitude": 36.973920949851, "longitude": 148.36797304112, "precision": 0.000000000001, "globe": "http://www.wikidata.org/entity/Q106948918" } <-- latitude set to maximum latitude clarified by syntax clarification (P2916) qualifier.
|
WESTERNMOST_LONGITUDE | 148.23651113052 <DEG> | coordinates of westernmost point (P1335) | { "latitude": 36.838131126084, "longitude": 148.23651113052, "precision": 0.000000000001, "globe": "http://www.wikidata.org/entity/Q106948918" } <-- latitude set to minimum latitude clarified by syntax clarification (P2916) qualifier.
|
MRO:OBSERVATION_START_TIME | 2018-01-21T12:51:50.434 | N/A | N/A |
START_TIME | 2018-01-21T12:51:50.582 | N/A | N/A |
SPACECRAFT_CLOCK_START_COUNT | "1201006358:10651" | N/A | N/A |
STOP_TIME | 2018-01-21T12:51:53.012 | inception (P571) and date field in template | date used as value for wikidata property, full time string parsed to data field for date field in wikitext template |
SPACECRAFT_CLOCK_STOP_COUNT | "1201006360:38785" | N/A | N/A |
PRODUCT_CREATION_TIME | 2018-01-25T05:01:36 | publication date (P577) but I am not completely sure here | date used as value for wikidata property. |
MRO:CCD_FLAG | (ON, ON, ON, ON, ON, ON, ON, ON, ON, OFF, ON, ON, ON, ON) | N/A | N/A |
MRO:BINNING | (1, 1, 1, 1, 1, 1, 1, 1, 1, -9998, -9998, -9998, -9998, -9998) | N/A | N/A |
MRO:TDI | (128, 128, 128, 128, 128, 128, 128, 128, 128, -9998, -9998, -9998, -9998, -9998) | N/A | N/A |
MRO:SPECIAL_PROCESSING_FLAG | (NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, "NULL", "NULL", "NULL", "NULL", "NULL") | N/A | N/A |
INCIDENCE_ANGLE | 42.714413 <DEG> | N/A | N/A |
EMISSION_ANGLE | 0.434473 <DEG> | tilt (P8208) | value: 0.434473 --> unit degree (Q28390) |
PHASE_ANGLE | 42.502572 <DEG> | N/A | N/A |
LOCAL_TIME | 15.10520 <LOCALDAY/24> | N/A | N/A |
SOLAR_LONGITUDE | 118.215906 <DEG> | N/A | N/A |
SUB_SOLAR_AZIMUTH | 173.163664 <DEG> | N/A | N/A |
NORTH_AZIMUTH | 270.000000 <DEG> | N/A | N/A |
FILE_NAME | "ESP_053850_2170_RED.JP2" | N/A | N/A |
RECORD_TYPE | UNDEFINED | N/A | N/A |
ENCODING_TYPE | "JP2" | N/A | N/A |
ENCODING_TYPE_VERSION_NAME | "ISO/IEC15444-1:2004" | N/A | N/A |
INTERCHANGE_FORMAT | BINARY | N/A | N/A |
UNCOMPRESSED_FILE_NAME | "ESP_053850_2170_RED.IMG" | N/A | N/A |
REQUIRED_STORAGE_BYTES | 1637741444 <BYTES> | N/A | N/A |
DESCRIPTION | "JP2INFO.TXT" | N/A | N/A |
INTERCHANGE_FORMAT | BINARY | N/A | N/A |
FILE_NAME | "ESP_053850_2170_RED.IMG" | N/A | N/A |
RECORD_TYPE | FIXED_LENGTH | N/A | N/A |
RECORD_BYTES | 50966 <BYTES> | N/A | N/A |
FILE_RECORDS | 32134 | N/A | N/A |
IMAGE | "ESP_053850_2170_RED.IMG" | N/A | N/A |
DESCRIPTION | "HiRISE projected and mosaicked product" | Could potentially be added to {{En}} in description | N/A |
LINES | 32134 | N/A | N/A |
LINE_SAMPLES | 25483 | N/A | N/A |
BANDS | 1 | N/A | N/A |
SAMPLE_TYPE | MSB_UNSIGNED_INTEGER | N/A | N/A |
SAMPLE_BITS | 16 | N/A | N/A |
SAMPLE_BIT_MASK | 2#0000001111111111# | N/A | N/A |
SCALING_FACTOR | 1.41615214363203e-04 | N/A | N/A |
BANDS | 1 | N/A | N/A |
OFFSET | 0.060336154982679 | N/A | N/A |
BAND_STORAGE_TYPE | BAND_SEQUENTIAL | N/A | N/A |
CORE_NULL | 0 | N/A | N/A |
CORE_LOW_REPR_SATURATION | 1 | N/A | N/A |
CORE_LOW_INSTR_SATURATION | 2 | N/A | N/A |
CORE_HIGH_REPR_SATURATION | 1023 | N/A | N/A |
CORE_HIGH_INSTR_SATURATION | 1022 | N/A | N/A |
CENTER_FILTER_WAVELENGTH | 700 <NM> | Should be added to wikitext template along with FILTER_NAME as the images will be uploaded as PNG 16 bit grayscale | N/A |
MRO:MINIMUM_STRETCH | 3 | N/A | N/A |
MRO:MAXIMUM_STRETCH | 1021 | N/A | N/A |
FILTER_NAME | "RED" | N/A | N/A |
Additionally I propose the following the properties
- media type (P1163) --> "image/png"
- source of file (P7482) --> file available on the internet (Q74228490) --> ((described at URL (P973) --> value: url to LBL file) and (full work available at URL (P953) --> value: direct URL to JP2 file) and (operator (P137) --> University of Arizona (Q503419)) and perhaps (file format (P2701) --> JP2 (Q27979401)))
- copyright status (P6216) --> public domain (Q19652) --> determination method or standard (P459) --> work of the federal government of the United States (Q60671452)
- instance of (P31) --> photograph (Q125191)