this post was submitted on 13 Aug 2024
52 points (91.9% liked)

Technology

58009 readers
2984 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s@lemmy.world
enu@lemm.ee
fry@fry.gs
L3s@fry.gs
enu@lemmy.world
L4s@fry.gs
L4s@lemmy.world
52
Efficiently Manage Memory Usage in Pandas with Large Datasets (geekpython.in)
submitted 1 month ago by Aalonatech@lemmy.world to c/technology@lemmy.world
7 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[โ€“] Nomecks@lemmy.ca 3 points 1 month ago (5 children)

Is there a benefit to doing CoW with Pandas vs. offloading it to the storage? Practically all modern storage systems support CoW snaps. The pattern I'm used to (Infra, not big data) is to leverage storage APIs to offload storage operations from client systems.

[โ€“] LunarLoony@lemmy.sdf.org 1 points 4 weeks ago

I'm confused by all this talk of black-and-white animals. Can we instead use a Zebra node and put it behind a TuxedoCat cluster? I've also heard good things about barred-knifejaw as a data warehouse.

(Genuine question: what are Pandas and Cows in this context?)

load more comments (4 replies)