A bookkeeper records what happened: transactions categorized, accounts reconciled, reports produced. An accountant interprets what happened: analyzing the numbers and advising on decisions. A CPA is a licensed accountant who passed a national exam and is held to professional standards by a state licensing board.
Most small businesses need a bookkeeper for the day-to-day work and a CPA for oversight, tax strategy, and bigger financial decisions. What they don't need is a tax preparer who looks at their books once a year and calls it accounting.