As a business owner, it is imperative that you always keep clear and accurate records.
You will want to keep all of your receipts, because without receipts there are no deductions. And no deductions means more money you pay to the CRA
You will want to keep your records up to 7 years, just in case the CRA decides to audit you.