this post was submitted on 02 Aug 2024
592 points (98.4% liked)

linuxmemes

20688 readers
1143 users here now

I use Arch btw


Sister communities:

Community rules

  1. Follow the site-wide rules and code of conduct
  2. Be civil
  3. Post Linux-related content
  4. No recent reposts

Please report posts and comments that break these rules!

founded 1 year ago
MODERATORS
 

It was also actually pretty fun!

top 46 comments
sorted by: hot top controversial new old
[–] tomkatt@lemmy.world 116 points 1 month ago (2 children)

Give me more of this and less of the politics. This is what I come to Lemmy for.

[–] umbrella@lemmy.ml 9 points 1 month ago

subscribe to the linux comms and not to the politics comms

[–] Prunebutt@slrpnk.net 51 points 1 month ago* (last edited 1 month ago) (2 children)

Impressive, sounds like magic, tbh! You know any tutorials?

[–] cm0002@lemmy.world 88 points 1 month ago (4 children)

Not really, I pulled it together from a bunch of random posts lol

Maybe I should write one, but in essence you:

  • Stop all non-OS essential services

  • Create a filesystem in a chunk of RAM

  • Pull essential OS files from the installed OS into it recreating needed directories (Though you could probably just use a tiny pre-built distro but meh)

  • Pivot root into it

  • Reload services (when they restart they'll be restarted in the context of where you pivot rooted, prior they're still running under the context of the installed OS)

  • Unmount the boot drive

  • Then do what ever you need to do

  • ???

  • Profit

[–] exu@feditown.com 25 points 1 month ago (2 children)

How exactly so you pivot root? Simply chroot or something more involved?

[–] cm0002@lemmy.world 73 points 1 month ago (2 children)

chroot isn't enough, you need "real" pivot_root

chroot just changes the shells root point, pivot_root actually changes the root mount point and enables this trick to work

[–] 4am@lemm.ee 26 points 1 month ago

This is god-tier technique, kudos

[–] pineapplelover@lemm.ee 11 points 1 month ago
[–] barkingspiders@infosec.pub 15 points 1 month ago

I work in this field and I think this is 🔥 af

[–] InnerScientist@lemmy.world 6 points 1 month ago

FYI you can use kexec and a prepared initrd to do something similar with only one command.

[–] Wilzax@lemmy.world 3 points 1 month ago

Imagining this process, despite having never done 50% of the steps on the list, makes my brain imagine this: Turning a sphere outside in

[–] A_cook_not_a_chef@lemmy.world 27 points 1 month ago (1 children)

Yeah, I'd love to see a write up on this to follow.Sounds like useful practice in the lab if nothing else.

[–] smb@lemmy.ml 3 points 1 month ago

i experimented with this some time ago, see my post here: https://lemmy.ml/post/18706002/12772832

[–] aMockTie@lemmy.world 28 points 1 month ago (4 children)

What happens if the SSH session closes before dd finishes? Sounds pretty badass but I don't think I would trust this approach in prod lol

[–] cm0002@lemmy.world 32 points 1 month ago (1 children)

Well the 1 SSH session bit was for dramatic meme-effect lol, you can actually connect back without issue (at least it did for me) so worst case if you weren't working in tmux you'd just have to start dd again

Worst worst case, you'd just end up back where you were probably heading before anyways, KVM/IPMI

[–] aMockTie@lemmy.world 6 points 1 month ago

Sure, I suppose as long as sshd is up and running in the ramdisk environment (which you mentioned in another comment, along with all other services) you could always reconnect. Very neat and clever!

[–] exu@feditown.com 10 points 1 month ago (1 children)

You could use screen or tmux for a persistent terminal session.

[–] aMockTie@lemmy.world 11 points 1 month ago

True, but I was more thinking about the issue of reconnecting in general when you just nuked sshd.

[–] InnerScientist@lemmy.world 2 points 1 month ago

As long as you only copy off the disk, you can just reboot and the whole system in RAM vanishes and the normal system boots again for the second try.

[–] possiblylinux127@lemmy.zip 1 points 1 month ago

Maybe run ssh on 2 different ports?

[–] Norodix@lemmy.world 24 points 1 month ago

I also vote for a writeup. This sounds awesome!

[–] MataVatnik@lemmy.world 21 points 1 month ago (2 children)

Can someone ELI5? Are you freefloating an operating system on your RAM?

[–] cm0002@lemmy.world 36 points 1 month ago (1 children)

I had a server I rented from a provider in a data center and I wanted to image (dd) the drive for archival before I decommissioned it from my infrastructure.

Normally, you can't really do that with the OS running and you would have to shut down and insert a live USB or something and temporarily boot from that. The server being a faraway rental the only option was to open a ticket so that they could enable an out-of-band management option like KVM or IPMI. Which would allow you to control a machine as if you had a physical monitor, keyboard and mouse in front of you. With that you can attach flash drives, shutdown, restart, see the POST/BIOS/UEFI screens etc remotely .

But, I didn't want to wait 6-8 hours for them to enable that so instead I put together a process that would "boot" me into another distro "installed" into a RAM disk (kinda like how live CD/USB works) from the currently installed and running OS without rebooting

From there I could unmount the boot disk and do what ever I wanted from there, I could have even wiped the disk entirely and installed a entirely different distro if I wanted

[–] AVincentInSpace@pawb.social 10 points 1 month ago

How do you do that? What minimal distro did you use? Did you make it yourself? How reliable is pivot-root? How many tries did it take you to do that successfully?

[–] Croquette@sh.itjust.works 17 points 1 month ago

RAM is still memory, so you can put anything in there, like an OS.

With pivot_root, you can change where the root is. So you pivot into your OS in RAM, which becomes the root of the system.

At that point, you can do pretty much anything you would normally do with your OS, like unmount a HDD.

I've never personally done it, but that's a simplified explanation of what OP did.

[–] gaylord_fartmaster@lemmy.world 19 points 1 month ago

I did this once to install a different distro on a free oracle VPS lol

[–] Pacmanlives@lemmy.world 14 points 1 month ago* (last edited 1 month ago) (1 children)

Hopefully you don’t lose power or something else bad happens or there goes your data

[–] Ajen@sh.itjust.works 5 points 1 month ago

If that happens, they just fall back to the first option of waiting for their provider to set up the IPMI.

[–] bss03@infosec.pub 13 points 1 month ago (1 children)

I've never gotten pivot_root to work well / as documented. Major props for being able to pull this off. Hopefully you didn't have much time where a connection-drop would require a reboot. SSH in the new root on an alternate port before the pivot? idk.

[–] cm0002@lemmy.world 8 points 1 month ago (1 children)

Really? It seemed to go pretty smooth for me, SSH dropped once I think when I reloaded the services (expected), but after that I was able to connect back fine on the same port no issue

[–] bss03@infosec.pub 1 points 1 month ago

It's been a LONG time since I tried, but ISTR it complaining that it couldn't move the old_root because it was in use? But, when I'd fuser it, the only think that was using it was my shell (using it as the current directory).

[–] mvirts@lemmy.world 11 points 1 month ago (1 children)

read this over on Linux community a few days ago

https://cloudbsd.xyz/

[–] cm0002@lemmy.world 5 points 1 month ago

Damn lol wish I would have come out sooner lmao Seems a tad more complicated though, I don't remember having to compile anything at least

[–] michel@friend.ketterle.ch 9 points 1 month ago

@cm0002
I need that!

Is there a tutorial for that? I have an Old outdated Synology nas that I wish to replace the system with an Open Media Vault.

[–] ChojinDSL@discuss.tchncs.de 7 points 1 month ago

Check out dattobd sometime. It's a tool that allows you to make a snapshot of a block device for backups, while the OS is running. Useful if your filesystem doesn't support snapshots.

[–] undefined@links.hackliberty.org 6 points 1 month ago* (last edited 1 month ago) (2 children)

I’ve been killing myself in my free time to get a NanoPi R6S to boot from an SD card; wish I had this expertise.

Edit: I didn’t say this very clearly, I’ve been killing myself to build and compile U-Boot, the Linux kernel then building an image to write to an SD card that’ll actually boot.

[–] cm0002@lemmy.world 7 points 1 month ago (1 children)

Heh, this expertise is built on hundreds of "Why tf won't X boot from Y!!" and solid research skills lol you'll get there

[–] undefined@links.hackliberty.org 1 points 1 month ago

Oops, I realize now that my comment made it seem like I can’t figure out how to write an image to external media and boot it properly. It was actually more intense than that, so I’ve updated it.

[–] PlexSheep@infosec.pub 2 points 1 month ago (1 children)

Not sure about your hardware, but try to look up if it requires a special kernel, like the RPi 5 (which only runs on raspbian because they ship that kernel)

[–] undefined@links.hackliberty.org 1 points 1 month ago

The manufacturer ships several tools but a lot of the necessary files are shared from Google Drive, and each time I try to download one it says “download limit exceeded.” My goal is to build something more vanilla — I can see that the hardware is supported in the mainline kernel so I’m doing this with tons of trial and error (which I don’t mind).

I’m doing everything in a Dockerfile so once I’m there the goal is to clean it up and push it to GitHub.

[–] smb@lemmy.ml 4 points 1 month ago* (last edited 1 month ago)

i had experimented with kexec and takeover.sh to install a distro that was not available by my provider.

it resulted in some scripts i now (triggered by this thread) have published (in a nonready state):

http://github.com/tobinq/goaround

the scripts may be in bad shape but i successfully changed one preinstalled ubuntu to a devuan with what is in these scripts. however i didn't work on them for month now and am not sure about that last state.. so its experimental only.

[–] ninekeysdown@lemmy.world 4 points 1 month ago

Once I figured out how to netboot the os into memory that's how I run all my nodes :)

[–] possiblylinux127@lemmy.zip 2 points 1 month ago

I have never gotten it to work. It always implodes