Magic wand time: Make the entire bay area a single entity like NYC, Tokyo, or London. Extend the zoning plan to the entire bay area, get rid of minimum parking space requirements in other cities in the metro, invest in transit and build infill stations in the new areas with planned increases in density.
The drug problem is another issue, but if the bay area were more affordable there would be fewer people forced out on to the streets who then turn to drugs.