In the Name of Allah, The Most Gracious, Most Merciful
Dear brothers, what prevents you from inviting your close brothers in faith to your house, to invite a notable scholar, who is known by his piety and deep religious knowledge, and to spend this blessed meeting talking about the prophet PBUH and about his traits, his conducts, his passion, his message and his miracles?
Doing so is crucial part of the religion; however beware of considering that as an act of worship.
The acts of worship are based on prohibiting and no act of worship should be imposed without a decisive proof from Quran and Sunnah.
Basically, everything is allowed unless it is prohibited according to a decisive proof.
Praise be to Allah, The Lord (The One and Only) of the worlds. Blessings and peace be upon our master, Prophet Muhammad, the Truthful and the Faithful.