But it's most commonly seen inside a name: Think Olivia, Ava, Evelyn and Avery.. Baby names that start with the letter "V" still stand out from the crowd. Violet, Valentina, Valerie, Victoria ...