The key to thawing frozen pipes is consistent gentle heat. Use a space heater or hairdryer but never an open flame. When in doubt, call a plumber.
If you're preparing to become a homeowner for the first time, you have a lot on your plate. You want to educate yourself about the process and about various operational systems inside your home, ...