I want to show articles blog-like: Titles ordered by date (newst first) and categories on the sidebar. How can I do that? Because when I add a K2 button to the main menu, categories are listed before articles. I can hide them, but there's no "Categories Module" to insert in the sidebar.

You can use the K2 Tools module which offers a category list.