Also check to see what else you have running in the back ground that stays resident in RAM. Not at all uncommon for 4GB to be eat up doing nothing.
If you have a crowded desktop with Icons all over it clean that up, hi res wall paper, ditch that too. every icon and desktop image eats up memory.
Me, I dont even use a swap/page file. Turned it off but then again Im running 64GB RAM, 4x16GB kit.

“Two things are infinite: the universe and human stupidity, I'm not sure about the former” ~ Albert Einstein