Creating synthetic data to increase the training data for ML model

I was wondering if I can create more data from the available dataset to train my model and what are the pitfalls of such a practice?

I have a modest number of examples in my dataset, but I believe that if I increase the size of the data, training gets even better (I tried and tested it).

Thanks Shan