Any body have idea how to check if its problem with the fuse or something else?If it is the fuse how to change it?

you have a fuse box under the dash by the brake pedal. look on the cover of the fuse box for "cig lighter" and check to see if the metal line inside the fuse is broke, thats how you tell if you need a fuse, if it is not the fuse then it might be your charger.

Not sure what you mean by the cars charger . If you are saying the battery won`t hold a charge any "Auto-Zone" can test it for free. Also test the alternater too while they are at it .Check the cables on the battery for looseness and corrosion .