At this point, your new public key should be on your EC2 instance in the authorized_keys file, and all you have to do is remove the old one.

Amazon Web Services offers up a remote development setup for Visual Studio Code developers that involves an SSH connection to leverage the AWS Cloud9 IDE and other functionality.