Wordpress by default doesn't let us upload SVG files. We can easily change this behaviour with a simple function in the functions.php file.
