Anyone in Bakersfield been up to Oak Flat Fire Lookout on Rancheria Rd/25S03?

I rented it for a couple of nights in early August and am wondering if there's a forest route down to any natural swim spots on the Kern river. Ideally under an hour's drive. Google maps says it's 1 hour and 45 min to Lake Isabella, which is too long bc I'll have my 4 year old. I'd rather find something quieter like a swimming hole with some shade on the river anyway.

I see freeway ridge is close by but not sure if I can get to the tower on that route. I've never driven that trail either so I don't know how difficult it is besides what I can find on youtube.

Also does anyone know how long it takes to get to the tower via 25S03 from the turnoff at hwy 178? Google maps again says 45 min but as you know it often gets drive times way too long on forest routes.