Do i let my brother win or not?

It sounds like your brother is excessively immature. Tell him to grow up and to stop playing if he doesn't like the way it's working out for him.