When I say negatively affect you though- I really mean negatively affect.
If you're a fighter I want to see a flaw that affects melee combat or HP.
If a ranger something that affects bows (Presuming that's your focus)
And so on and so forth.
No D&D Wiki
Also- skill point increases will be retroactive. It's as if a shiny bright light went on in your head