ECS cluster is just a logical group of your task definition, so if you are able to connect to RDS from task definition you should be able to run the same task definition. make sure a task definition has proper IAM Role attached to connect to RDS.