The key difference is that regular vanilla ice cream has a milk or cream base. French vanilla, on the other hand, includes egg yolks to make a creamier custard base.