To customize the sidebar from your admin area, go to Dashboard > Appearance > Customize>Sidebar.
There you can find sidebar option where after entering in the sidebar you can find controls which helps to customize sidebars as per need.
You can use sidebar layout to display sidebar as per the given options. Widget Typography can also help to change the font variant of the widgets.
