If your data is a table — rows and columns — classical machine learning like random forests or XGBoost will usually beat a neural network and train in seconds.
If your data is images, audio or free text, deep learning is the right tool, and transfer learning lets you get good results without a huge dataset.
Whichever you choose, report honest metrics on a held-out test set.