Is there a way to associate more than one video with an article?

Is there a lightbox option for playing the videos?

If there is documentation I'd be more than happy to look there but I can't find any.

You can use AllVideo Plugin and set Videos in you Article.
In the Video Tab in Backend you can just set one Video.