Tutorials

• Loading Data into Nested-Pandas
  • Installation and Imports
• Overview
• Converting Flat Data
  • Converting from Flat Pandas
  • Inserting Nested Rows
• Loading Data from Parquet Files
• Saving NestedFrames to Parquet Files
• Fine Data Manipulation with Nested-Pandas
  • Nested Column Selection
  • Adding or Replacing Nested Columns
  • Adding New Nested Structures
  • Embedding “base” column into nested column
  • Concatenating Nested Frames
  • Combining Nested Structures
  • Advanced Manipulation with .eval()
• Lower-level interfaces
  • Reveal the hidden power of nested Series
  • Generate some data and get a Series of NestedDtype type
  • Get access to different data views using the .nest accessor
    • .nest object is a mapping
    • Different data views
  • Use familiar pandas masking operations through the .nest accessor
  • Convert to and from nested Series
    • To and from pd.ArrowDtype
    • pack() function for creating a new nested Series
      • Using pack() to nest a flat dataframe
      • Using pack() to nest a collection of elements
    • Using pd.Series(values, dtype=NestedDtype.from_fields({…}))
      • pd.Series from a sequence of elements
      • pd.Series from an array
    • Convert nested Series to different data types
      • Convert to a collection of nested elements
• Using Nested-Pandas with Astronomical Spectra
• Using GroupBy with Nested-Pandas
  • Basic Aggregations
  • Type Preservation
  • Custom Functions with apply
  • Summary
• Using Numba JIT with Nested-Pandas map_rows
  • Usage and Limitations
  • Examples and Benchmark
    • Max Slope - Two Nested Input Arguments
      • Average Runtime
      • Asymptotic Behavior
    • Weighted Mean Slope - Two Nested Input Arguments
      • Average Runtime
      • Asymptotic Behavior
      • Special Case - Explicit Looping (no numpy)
      • Aysmptotic Behavior for Looping
    • Scaled Max Flux - Two Input Arguments with Mixing Type
      • Average Runtime
      • Special Case - Exploded Base Column
    • Sum of max 3 - Three Input Arguments with Mixing Type
  • Takeaways