I will not be a VAT company, when I have expenses should the full cost I paid for the expense (+VAT) be taken into account when finding my business profit for tax year?

I will not be a VAT company, as I won't be earning over the threshold of selling to other VAT companies. My company is an Ear Microsuction Service. 
At the end of the tax year and you provide details of your expenses to find out your taxable profit, is the VAT I have paid for these expenses taken into account within the whole cost of the expense?