In this response to a Philadelphia abolitionist, James Madison made the case for a gradual approach to ending slavery. A lifelong member of the American Colonization Society, Madison argued that freed slaves had to be sent elsewhere to live. He also thought that masters who lost their slaves to emancipation deserved financial compensation.