Some setting in about:config maybe? It's kinda ridiculous that it disappears with like 12 tabs open.
(I know I can click scroll-wheel on my mouse to close it, but it's still a problem when I'm using trackpad)
If you set browser.tabs.tabClipWidth to 0, it will show the close button until it needs to start scrolling tabs.