This would mean that a small change in price would lead to an infinitely large increase in Demand.

In perfectly competitive markets (such as, say, coal), if you can charge slightly less than your competitors, and still make a profit, you will find your customers will attempt to buy as much as you can produce.