So I made it work by adding the following things in my org.eclipse.core.runtime.products extension,
<property
name="cssTheme"
value="org.eclipse.e4.ui.css.theme.e4_default">
</property>
<property
name="applicationCSSResources"
value="platform:/plugin/org.eclipse.platform/images/">
</property>
I don't know if this is the proper way of doing it so I am open to suggestions.