Honestly, it's patchy.
'ball on a table' is very generic, so my brain keeps suggesting different versions. A beach ball on my grandparents' living room table when I was a child. A fairly featureless basketball-sized sphere on a beech-like table in some kind of gallery-like environment. A tennis ball, but on little more than the concept of a table. The person, not being specified... could be anyone. In some versions it's my own arm, POV, in others it's like something seen out of the corner of your eye. Yeah someone came in and did a thing, I wasn't really looking.
The motion is more like a series of vignettes, unless I concentrate more - in which case the surrounding detail gets more abstract.
Now, if you give me details, that's another story.
A fuzzy yellow tennis ball on that cheap folding card table from my childhood with the padding cut off, leaving the textured fibreboard surface. My older sister strides up and shoves the ball across the table, making the flimsy legs wobble as she does so.
Do that, I can see the texture of the carpet and the bare walls from our shitty childhood apartment, I can downright smell the table and have the heft of the thing kinaesthetically along with the shape and visual textures. I can see the skitter and wobble of the ball across the table; my sister more an abstract bundle of mannerisms and gait, and the actual path of the ball is still more implied than observed, though.
For the most part, my visualisation is handwave, like looking through your blind spot or your peripheral vision: the part your brain makes up to fill in the missing details. When I read a book, it's like half-remembered cover-illustrations of the general scene: more vibe (sometimes richly textured, vivid vibe) than a literal image.