So after i spend points i seem to be getting them back ...

You broke the system. BANNU.

Well, others created giveaways so points are added. There.

The point system is designed to prevent users from entering for every single giveaway. This lowers the overall number of entries, and provides everyone with better odds of winning games they're interested in playing. New users start out with 25P. Every time anyone submits a game, every member of the site, excluding the giveaway creator, receives 5 percent of that gifts value (in USD) in points. For example, if a $50 gift is created, every user on the site receives 2.5 points. And, if a $20 gift is created, everyone would receive 1 point. These points can then be spent on entering giveaways.

So you can enter more giveaways.

At the top of the forum page there is a topic with FAQs, read them and you will know all you need

If you suddenly receive a large boost in points, either a lot of high-value giveaways were created quickly (this has happened a lot in the last couple of weeks) or a giveaway you entered was deemed fake and deleted by the moderators (whether it's open or closed, you will have your points returned).

Because the Steam Gifts community is filled with alot of awesome people constantly making giveaways.