What is the main cause of rising fuel prices?

We are concerned that while dealers often respond swiftly by hiking pump prices whenever crude prices rise, it is curious that it is taking forever for consumers to benefit significantly when crude prices fall. Competitive markets must work fairly in both directions.