CO2 combines with rain/stream water (H2O) to form the (weak) acid H2CO3. Carbonate rocks are particularly sensitive to alteration/erosion by this H2CO3 ('carbonic acid'), thus the karst topography (caves, tunnels) in limestone landscapes.
Yes as mentioned before, CO2 can react with rains or the stream water (H2O) to form the carbonic acid H2CO3 which is a weak acid. Therefore it has an acidity effects.