Use NOT(ISNEW()) to fire validation rule only in update operation in Salesforce.

Sample Validation rule:

AND(
 NOT(ISNEW()),
 ISCHANGED( City__c ),
 ISCHANGED( State__c )  
)

Cheers!!!