Fat won't make you fat, but it can easily add a ton of calories to your meals, which in turn makes it more likely for you to consume more food than you actually need.
For instance, the difference between dry-baked & oil-baked potatoes is right about 200 calories...
And this is not little!
Nevertheless, fat intake should be well optimized, as dietary fats are essential for the body and many of its functions.
Optimal daily fat intake forms at 0.35-0.45g per lb of bodyweight and should come from animal foods, fatty fish, nuts, avocados, olive oil, etc.
This will allow you to sustain the healthy functioning & structure of many tissues & processes!