Does the expansion joint need to extend into the concrete foundation?

The expansion joint is generally installed on top of the concrete foundation and below the base plate within the area where the epoxy grout will be poured.

How far above the base plate should the anchor bolt extend?

Anchor bolts should extend at least 2 inches above a fully engaged nut.