It belongs to a group of plants that have milky sap, or latex, and includes the rubber tree (Ficus elastica) along with a number of popular houseplants. Do be aware that contact with fig tree sap ...

Or should I remove it and keep it in pots? Thank you. – David Guay The tree is most likely a Ficus elastica or rubber fig, based on the broad, glossy leaves and reddish-purple hue of the new growth.