What happens if I just ignore a wrong challan?

Don't ignore it. Unpaid challans can block RC and licence renewals, fitness, and resale, and a challan sent to court can become a court summons.

Contest it instead — it is free, and a genuinely wrong challan is usually dropped once you show proof.