Yes! Bike lanes are car infrastructure. Anything that is creates to stop a car/driver from driving their car on to, or in to it, is car infrastructure.

Sidewalks for example were created to prevent cars for driving up or in the area. Crosswalks were created to standardize crossing zones where cars might expect pedestrians.

Prior to this city streets were for people, not their vehicles.