The bite itself doesn't kill you. When the virus starts coursing through your veins it slowly starts killing you. When you die, you turn into a zombie.
Half true. Everyone is already infected. A zombie bite, much like any bite, if left untreated will get infected and can kill you. Once you die, you reanimate.