Corruption starts with your 3rd town and it is in each town. Corruption affects resource production, culture and science spending. It is 10% in EACH town, for all 3 things. And each town after that will add an additional 10% corruption.
Few build more than 6 towns, as the corrupt is to painful. In later ages, there are some building that help with corruption, but it is still a big factor.