Should I include the cost of utilities in my Monthly Housing Expense amount?

No. For Monthly Housing Expense, only include the amount of your rent or mortgage payment.