Scaling up in Earth Engine Article Swipe
Jillian M. Deines
,
Stefania Di Tommaso
,
Nicholas Clinton
,
Noel Gorelick
·
YOU?
·
· 2023
· Open Access
·
· DOI: https://doi.org/10.1007/978-3-031-26588-4_29
YOU?
·
· 2023
· Open Access
·
· DOI: https://doi.org/10.1007/978-3-031-26588-4_29
Commonly, when Earth Engine users move from tutorials to developing their own processing scripts, they encounter the dreaded error messages, “computation timed out” or “user memory limit exceeded”. Computational resources are never unlimited, and the team at Earth Engine has designed a robust system with built-in checks to ensure that server capacity is available to everyone. This chapter will introduce general tips for creating efficient Earth Engine workflows that accomplish users’ ambitious research objectives within the constraints of the Earth Engine ecosystem. We use two example case studies: (1) extracting a daily climate time series for many locations across two decades and (2) generating a regional, cloud-free median composite from Sentinel-2 imagery.
Related Topics
Concepts
Metadata
- Type
- book-chapter
- Language
- en
- Landing Page
- https://doi.org/10.1007/978-3-031-26588-4_29
- https://link.springer.com/content/pdf/10.1007/978-3-031-26588-4_29.pdf
- OA Status
- gold
- References
- 4
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4387344683
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4387344683Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1007/978-3-031-26588-4_29Digital Object Identifier
- Title
-
Scaling up in Earth EngineWork title
- Type
-
book-chapterOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2023Year of publication
- Publication date
-
2023-10-02Full publication date if available
- Authors
-
Jillian M. Deines, Stefania Di Tommaso, Nicholas Clinton, Noel GorelickList of authors in order
- Landing page
-
https://doi.org/10.1007/978-3-031-26588-4_29Publisher landing page
- PDF URL
-
https://link.springer.com/content/pdf/10.1007/978-3-031-26588-4_29.pdfDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://link.springer.com/content/pdf/10.1007/978-3-031-26588-4_29.pdfDirect OA link when available
- Concepts
-
Computer science, Scripting language, Workflow, Cloud computing, Computation, Earth observation, Distributed computing, Operating system, Database, Engineering, Aerospace engineering, Satellite, Programming languageTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- References (count)
-
4Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4387344683 |
|---|---|
| doi | https://doi.org/10.1007/978-3-031-26588-4_29 |
| ids.doi | https://doi.org/10.1007/978-3-031-26588-4_29 |
| ids.openalex | https://openalex.org/W4387344683 |
| fwci | 0.0 |
| type | book-chapter |
| title | Scaling up in Earth Engine |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | 602 |
| biblio.first_page | 575 |
| topics[0].id | https://openalex.org/T10111 |
| topics[0].field.id | https://openalex.org/fields/23 |
| topics[0].field.display_name | Environmental Science |
| topics[0].score | 0.983299970626831 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2303 |
| topics[0].subfield.display_name | Ecology |
| topics[0].display_name | Remote Sensing in Agriculture |
| topics[1].id | https://openalex.org/T11986 |
| topics[1].field.id | https://openalex.org/fields/18 |
| topics[1].field.display_name | Decision Sciences |
| topics[1].score | 0.9474999904632568 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1802 |
| topics[1].subfield.display_name | Information Systems and Management |
| topics[1].display_name | Scientific Computing and Data Management |
| topics[2].id | https://openalex.org/T13398 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9314000010490417 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1702 |
| topics[2].subfield.display_name | Artificial Intelligence |
| topics[2].display_name | Data Analysis with R |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.68388831615448 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C61423126 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6543537378311157 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q187432 |
| concepts[1].display_name | Scripting language |
| concepts[2].id | https://openalex.org/C177212765 |
| concepts[2].level | 2 |
| concepts[2].score | 0.6353464126586914 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q627335 |
| concepts[2].display_name | Workflow |
| concepts[3].id | https://openalex.org/C79974875 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5718875527381897 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q483639 |
| concepts[3].display_name | Cloud computing |
| concepts[4].id | https://openalex.org/C45374587 |
| concepts[4].level | 2 |
| concepts[4].score | 0.47295281291007996 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q12525525 |
| concepts[4].display_name | Computation |
| concepts[5].id | https://openalex.org/C39399123 |
| concepts[5].level | 3 |
| concepts[5].score | 0.44933977723121643 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q1348989 |
| concepts[5].display_name | Earth observation |
| concepts[6].id | https://openalex.org/C120314980 |
| concepts[6].level | 1 |
| concepts[6].score | 0.3289111852645874 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q180634 |
| concepts[6].display_name | Distributed computing |
| concepts[7].id | https://openalex.org/C111919701 |
| concepts[7].level | 1 |
| concepts[7].score | 0.22297942638397217 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q9135 |
| concepts[7].display_name | Operating system |
| concepts[8].id | https://openalex.org/C77088390 |
| concepts[8].level | 1 |
| concepts[8].score | 0.21229040622711182 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q8513 |
| concepts[8].display_name | Database |
| concepts[9].id | https://openalex.org/C127413603 |
| concepts[9].level | 0 |
| concepts[9].score | 0.17115923762321472 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[9].display_name | Engineering |
| concepts[10].id | https://openalex.org/C146978453 |
| concepts[10].level | 1 |
| concepts[10].score | 0.14059069752693176 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q3798668 |
| concepts[10].display_name | Aerospace engineering |
| concepts[11].id | https://openalex.org/C19269812 |
| concepts[11].level | 2 |
| concepts[11].score | 0.13616445660591125 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q26540 |
| concepts[11].display_name | Satellite |
| concepts[12].id | https://openalex.org/C199360897 |
| concepts[12].level | 1 |
| concepts[12].score | 0.07422593235969543 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q9143 |
| concepts[12].display_name | Programming language |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.68388831615448 |
| keywords[0].display_name | Computer science |
| keywords[1].id | https://openalex.org/keywords/scripting-language |
| keywords[1].score | 0.6543537378311157 |
| keywords[1].display_name | Scripting language |
| keywords[2].id | https://openalex.org/keywords/workflow |
| keywords[2].score | 0.6353464126586914 |
| keywords[2].display_name | Workflow |
| keywords[3].id | https://openalex.org/keywords/cloud-computing |
| keywords[3].score | 0.5718875527381897 |
| keywords[3].display_name | Cloud computing |
| keywords[4].id | https://openalex.org/keywords/computation |
| keywords[4].score | 0.47295281291007996 |
| keywords[4].display_name | Computation |
| keywords[5].id | https://openalex.org/keywords/earth-observation |
| keywords[5].score | 0.44933977723121643 |
| keywords[5].display_name | Earth observation |
| keywords[6].id | https://openalex.org/keywords/distributed-computing |
| keywords[6].score | 0.3289111852645874 |
| keywords[6].display_name | Distributed computing |
| keywords[7].id | https://openalex.org/keywords/operating-system |
| keywords[7].score | 0.22297942638397217 |
| keywords[7].display_name | Operating system |
| keywords[8].id | https://openalex.org/keywords/database |
| keywords[8].score | 0.21229040622711182 |
| keywords[8].display_name | Database |
| keywords[9].id | https://openalex.org/keywords/engineering |
| keywords[9].score | 0.17115923762321472 |
| keywords[9].display_name | Engineering |
| keywords[10].id | https://openalex.org/keywords/aerospace-engineering |
| keywords[10].score | 0.14059069752693176 |
| keywords[10].display_name | Aerospace engineering |
| keywords[11].id | https://openalex.org/keywords/satellite |
| keywords[11].score | 0.13616445660591125 |
| keywords[11].display_name | Satellite |
| keywords[12].id | https://openalex.org/keywords/programming-language |
| keywords[12].score | 0.07422593235969543 |
| keywords[12].display_name | Programming language |
| language | en |
| locations[0].id | doi:10.1007/978-3-031-26588-4_29 |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://link.springer.com/content/pdf/10.1007/978-3-031-26588-4_29.pdf |
| locations[0].version | publishedVersion |
| locations[0].raw_type | book-chapter |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Cloud-Based Remote Sensing with Google Earth Engine |
| locations[0].landing_page_url | https://doi.org/10.1007/978-3-031-26588-4_29 |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5069484790 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-4279-8765 |
| authorships[0].author.display_name | Jillian M. Deines |
| authorships[0].countries | US |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I142606810 |
| authorships[0].affiliations[0].raw_affiliation_string | Pacific Northwest National Laboratory, Earth Systems Predictability and Resiliency Group, Seattle, WA, USA |
| authorships[0].institutions[0].id | https://openalex.org/I142606810 |
| authorships[0].institutions[0].ror | https://ror.org/05h992307 |
| authorships[0].institutions[0].type | facility |
| authorships[0].institutions[0].lineage | https://openalex.org/I1325736334, https://openalex.org/I1330989302, https://openalex.org/I142606810, https://openalex.org/I39565521 |
| authorships[0].institutions[0].country_code | US |
| authorships[0].institutions[0].display_name | Pacific Northwest National Laboratory |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Jillian M. Deines |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | Pacific Northwest National Laboratory, Earth Systems Predictability and Resiliency Group, Seattle, WA, USA |
| authorships[1].author.id | https://openalex.org/A5005559785 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-0664-3651 |
| authorships[1].author.display_name | Stefania Di Tommaso |
| authorships[1].countries | US |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[1].affiliations[0].raw_affiliation_string | Center for Food Security and the Environment, Stanford University, Stanford, CA, USA |
| authorships[1].institutions[0].id | https://openalex.org/I97018004 |
| authorships[1].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[1].institutions[0].country_code | US |
| authorships[1].institutions[0].display_name | Stanford University |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Stefania Di Tommaso |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Center for Food Security and the Environment, Stanford University, Stanford, CA, USA |
| authorships[2].author.id | https://openalex.org/A5009411735 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-1112-1006 |
| authorships[2].author.display_name | Nicholas Clinton |
| authorships[2].countries | US |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I1291425158 |
| authorships[2].affiliations[0].raw_affiliation_string | Google LLC, Mountain View, CA, 94043, USA |
| authorships[2].institutions[0].id | https://openalex.org/I1291425158 |
| authorships[2].institutions[0].ror | https://ror.org/00njsd438 |
| authorships[2].institutions[0].type | company |
| authorships[2].institutions[0].lineage | https://openalex.org/I1291425158, https://openalex.org/I4210128969 |
| authorships[2].institutions[0].country_code | US |
| authorships[2].institutions[0].display_name | Google (United States) |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Nicholas Clinton |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Google LLC, Mountain View, CA, 94043, USA |
| authorships[3].author.id | https://openalex.org/A5083192483 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-5548-2436 |
| authorships[3].author.display_name | Noel Gorelick |
| authorships[3].countries | CH |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I4210100430 |
| authorships[3].affiliations[0].raw_affiliation_string | Google Switzerland, Zürich, Switzerland |
| authorships[3].institutions[0].id | https://openalex.org/I4210100430 |
| authorships[3].institutions[0].ror | https://ror.org/014f9c269 |
| authorships[3].institutions[0].type | company |
| authorships[3].institutions[0].lineage | https://openalex.org/I1291425158, https://openalex.org/I4210100430, https://openalex.org/I4210128969 |
| authorships[3].institutions[0].country_code | CH |
| authorships[3].institutions[0].display_name | Google (Switzerland) |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Noel Gorelick |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | Google Switzerland, Zürich, Switzerland |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://link.springer.com/content/pdf/10.1007/978-3-031-26588-4_29.pdf |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Scaling up in Earth Engine |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10111 |
| primary_topic.field.id | https://openalex.org/fields/23 |
| primary_topic.field.display_name | Environmental Science |
| primary_topic.score | 0.983299970626831 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2303 |
| primary_topic.subfield.display_name | Ecology |
| primary_topic.display_name | Remote Sensing in Agriculture |
| related_works | https://openalex.org/W2046765700, https://openalex.org/W4244478748, https://openalex.org/W1981780420, https://openalex.org/W2182707996, https://openalex.org/W4384345686, https://openalex.org/W2145834781, https://openalex.org/W4223488648, https://openalex.org/W2357937784, https://openalex.org/W45233828, https://openalex.org/W2964988449 |
| cited_by_count | 0 |
| locations_count | 1 |
| best_oa_location.id | doi:10.1007/978-3-031-26588-4_29 |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://link.springer.com/content/pdf/10.1007/978-3-031-26588-4_29.pdf |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | book-chapter |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Cloud-Based Remote Sensing with Google Earth Engine |
| best_oa_location.landing_page_url | https://doi.org/10.1007/978-3-031-26588-4_29 |
| primary_location.id | doi:10.1007/978-3-031-26588-4_29 |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://link.springer.com/content/pdf/10.1007/978-3-031-26588-4_29.pdf |
| primary_location.version | publishedVersion |
| primary_location.raw_type | book-chapter |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Cloud-Based Remote Sensing with Google Earth Engine |
| primary_location.landing_page_url | https://doi.org/10.1007/978-3-031-26588-4_29 |
| publication_date | 2023-10-02 |
| publication_year | 2023 |
| referenced_works | https://openalex.org/W1995047010, https://openalex.org/W2799805920, https://openalex.org/W2725897987, https://openalex.org/W2963508088 |
| referenced_works_count | 4 |
| abstract_inverted_index.a | 42, 91, 105 |
| abstract_inverted_index.We | 83 |
| abstract_inverted_index.at | 37 |
| abstract_inverted_index.is | 53 |
| abstract_inverted_index.of | 78 |
| abstract_inverted_index.or | 24 |
| abstract_inverted_index.to | 9, 48, 55 |
| abstract_inverted_index.(1) | 89 |
| abstract_inverted_index.(2) | 103 |
| abstract_inverted_index.and | 34, 102 |
| abstract_inverted_index.are | 31 |
| abstract_inverted_index.for | 63, 96 |
| abstract_inverted_index.has | 40 |
| abstract_inverted_index.own | 12 |
| abstract_inverted_index.the | 17, 35, 76, 79 |
| abstract_inverted_index.two | 85, 100 |
| abstract_inverted_index.use | 84 |
| abstract_inverted_index.This | 57 |
| abstract_inverted_index.case | 87 |
| abstract_inverted_index.from | 7, 110 |
| abstract_inverted_index.many | 97 |
| abstract_inverted_index.move | 6 |
| abstract_inverted_index.team | 36 |
| abstract_inverted_index.that | 50, 69 |
| abstract_inverted_index.they | 15 |
| abstract_inverted_index.time | 94 |
| abstract_inverted_index.tips | 62 |
| abstract_inverted_index.when | 2 |
| abstract_inverted_index.will | 59 |
| abstract_inverted_index.with | 45 |
| abstract_inverted_index.Earth | 3, 38, 66, 80 |
| abstract_inverted_index.daily | 92 |
| abstract_inverted_index.error | 19 |
| abstract_inverted_index.limit | 27 |
| abstract_inverted_index.never | 32 |
| abstract_inverted_index.their | 11 |
| abstract_inverted_index.timed | 22 |
| abstract_inverted_index.users | 5 |
| abstract_inverted_index.Engine | 4, 39, 67, 81 |
| abstract_inverted_index.across | 99 |
| abstract_inverted_index.checks | 47 |
| abstract_inverted_index.ensure | 49 |
| abstract_inverted_index.median | 108 |
| abstract_inverted_index.memory | 26 |
| abstract_inverted_index.out” | 23 |
| abstract_inverted_index.robust | 43 |
| abstract_inverted_index.series | 95 |
| abstract_inverted_index.server | 51 |
| abstract_inverted_index.system | 44 |
| abstract_inverted_index.within | 75 |
| abstract_inverted_index.chapter | 58 |
| abstract_inverted_index.climate | 93 |
| abstract_inverted_index.decades | 101 |
| abstract_inverted_index.dreaded | 18 |
| abstract_inverted_index.example | 86 |
| abstract_inverted_index.general | 61 |
| abstract_inverted_index.“user | 25 |
| abstract_inverted_index.Abstract | 0 |
| abstract_inverted_index.built-in | 46 |
| abstract_inverted_index.capacity | 52 |
| abstract_inverted_index.creating | 64 |
| abstract_inverted_index.designed | 41 |
| abstract_inverted_index.imagery. | 112 |
| abstract_inverted_index.research | 73 |
| abstract_inverted_index.scripts, | 14 |
| abstract_inverted_index.studies: | 88 |
| abstract_inverted_index.users’ | 71 |
| abstract_inverted_index.Commonly, | 1 |
| abstract_inverted_index.ambitious | 72 |
| abstract_inverted_index.available | 54 |
| abstract_inverted_index.composite | 109 |
| abstract_inverted_index.efficient | 65 |
| abstract_inverted_index.encounter | 16 |
| abstract_inverted_index.everyone. | 56 |
| abstract_inverted_index.introduce | 60 |
| abstract_inverted_index.locations | 98 |
| abstract_inverted_index.messages, | 20 |
| abstract_inverted_index.regional, | 106 |
| abstract_inverted_index.resources | 30 |
| abstract_inverted_index.tutorials | 8 |
| abstract_inverted_index.workflows | 68 |
| abstract_inverted_index.Sentinel-2 | 111 |
| abstract_inverted_index.accomplish | 70 |
| abstract_inverted_index.cloud-free | 107 |
| abstract_inverted_index.developing | 10 |
| abstract_inverted_index.ecosystem. | 82 |
| abstract_inverted_index.extracting | 90 |
| abstract_inverted_index.generating | 104 |
| abstract_inverted_index.objectives | 74 |
| abstract_inverted_index.processing | 13 |
| abstract_inverted_index.unlimited, | 33 |
| abstract_inverted_index.constraints | 77 |
| abstract_inverted_index.exceeded”. | 28 |
| abstract_inverted_index.Computational | 29 |
| abstract_inverted_index.“computation | 21 |
| cited_by_percentile_year | |
| corresponding_author_ids | https://openalex.org/A5069484790 |
| countries_distinct_count | 2 |
| institutions_distinct_count | 4 |
| corresponding_institution_ids | https://openalex.org/I142606810 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/13 |
| sustainable_development_goals[0].score | 0.7099999785423279 |
| sustainable_development_goals[0].display_name | Climate action |
| citation_normalized_percentile.value | 0.43057272 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |