Scaling Up with R and Apache Arrow

Bigger Data, Easier Workflows
1. Auflage 2025
ISBN: 978-1-032-66028-8
Verlag: Taylor & Francis Ltd

Buch, Englisch, 160 Seiten, Format (B × H): 156 mm x 234 mm, Gewicht: 453 g

Analyze large datasets directly from R. Scaling Up With R and Arrow provides a guide to working efficiently with larger-than-memory datasets using the arrow R package. As data grows in size and complexity, traditional data analysis methods in R often hit technical limitations. In this book, you'll learn how to overcome these hurdles without needing to set up complex infrastructure.

You'll learn about the Apache Arrow project's origins, goals, and its significance in bridging the gap between data science and big data ecosystems. You'll also learn how to leverage the arrow R package to work directly with files in various formats, such as CSV and Parquet, using familiar dplyr syntax. This book explores practical topics like data manipulation, file formats, working with larger datasets, and optimizing workflows for data in cloud storage. Advanced chapters examine user-defined functions, integration with other tools like DuckDB, and extending Arrow's capabilities to work with geospatial data.

Written by developers of the Arrow R package, this guide is essential for anyone looking to scale their data processing capabilities in R.

Zielgruppe

Professional Practice & Development

Autoren/Hrsg.

Keane, Jonathan

Crane, Nic

Richardson, Neal

Fachgebiete

• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Automatische Datenerfassung, Datenanalyse
• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Datenbankdesign & Datenbanktheorie
• Wirtschaftswissenschaften Betriebswirtschaft Management Projektmanagement
• Mathematik | Informatik EDV | Informatik Informatik Mensch-Maschine-Interaktion Informationsarchitektur
• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Data Mining
• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz Maschinelles Lernen
• Mathematik | Informatik EDV | Informatik Business Application Mathematische & Statistische Software
• Mathematik | Informatik EDV | Informatik Informatik Mensch-Maschine-Interaktion Informationsvisualisierung
• Mathematik | Informatik EDV | Informatik Programmierung | Softwareentwicklung Software Engineering

Inhaltsverzeichnis

Acknowledgements Foreword 1. Introduction 2. Getting Started 3. Data Manipulation 4. Files and Formats 5. Datasets 6. Cloud 7. Advanced Topics 8. Sharing Data and Interoperability References Appendices

Über Autor(innen)

Nic Crane is an R developer, educator, and general enthusiast, with a background in data science and software engineering. Nic is a member of the Apache Arrow Project Management Committee (PMC) and part of the team who maintains the arrow R package.

Jonathan Keane is an engineering manager with a background in software engineering and data science. Jonathan is a part of the team who maintains the Arrow project including the Arrow R package.

Neal Richardson is an engineering leader focused on building software that helps people work with data. He is a member of the Arrow PMC and one of the top contributors to the project.