We have an 8 room B&B and live off premises (4 miles away). During the week it's not bad because the bulk of our business is on the weekends (for now).
On the weekends there are 2 of us. Breakfast at 830am & immediately start cleaning up the kitchen from prep, then from clearing tables and then total cleaning once everyone vacates the dining room. As soon as the first couple checks out, the other innkeeper starts cleaning the rooms. I concentrate on the kitchen, dining & common areas and checking our guests out while the other is only doing rooms. As soon as I'm able, I start helping with rooms. We typically don't get out of there until 130-2pm and sometimes the rooms aren't even all done yet.
Check in is supposed to be at 3pm (and we tell people this several times) but they show up early, so it's not often possible to leave once the rooms are done. And then there's the 10pm walk-ins (like last night) that make you have to go back up there when you're already in your PJs.
It's non-stop and it can't be done without the two of us. There's never a day off and you're always on call. I've never had a guest complain about being left alone in the house - we see it as a bonus if there are no other guests that someone gets the quiet house to themselves..
I was going to add that if you wanted it to be a weekend only business, then it might work. But where we are, we have just as many weekday guests as weekend. You said you wanted it to be successful, what are the numbers now? (Not specifically, just asking what it is you hope to improve, and if so you will need to be there working).
Let's also add the term "ideal" to the mix. Many of us may operate in a way that may not be ideal, ie living in the basement or attic or not having enough personal space, or being a solo innkeeper, or unable to do any handywork ourselves and having to pay for everything, plus many more that may not be ideal to own and operate an inn successfully. How we manage and what we would change if we could from the get go are two different things. I would appreciate more space and time away from the inn, but owning an inn it is not ideal to live off premises. So it is doable, but not recommended.
.