Do I cover my employee's COBRA still even though his new job has insurance?

As the employer, if an employee has the option of taking insurance at his new job, do I still need to provide COBRA coverage whether or not he takes the new insurance?...shouldn't I be absolved from this now?