So I became friends with this guy in college about a year ago. He's not a very social person - I don't know any of his other friends, he doesn't share personal information easily, and is barely on talking terms with any of my friends (even though we all lived together in a dorm for 2 years). I do like spending time with him - he's very smart, and a good guy, but he's also a little too ... intense to spend too much time around.
Ideally, I would see him for 1-2 hours a week, spread out, and we'd get to hang out in small amounts. The way it happens is that I'll see him for about 4-5 hours at a stretch every three weeks or so, often late at night, when I'm tired (this could also be part of why I don't like spending too much time with him)
I haven't felt too guilty about getting him out of my room so I can sleep/work so far, because we lived in the same dorm. However, I'll be off campus next semester and I'd feel bad about dragging him out there for just an hour or two.
I invited him to someone's birthday party once - he showed up, spoke only to me, ate some cake, and left. I didn't see him wish the birthday girl. I doubt he'd be comfortable at parties.
I can't really say 'let's go get coffee somewhere' because that sounds too much like a date, and I won't be eating in the cafeteria too often since I'll be cooking. He also isn't on any social media and only uses normal text, which is something I barely use and often forget to check/respond to. So far his texts to me have been super short. He isn't big on small talk ("How did your exam go?" "We'll see when it's graded, won't we?"; "What's up?" "A bomb went off in a church in Sri Lanka"). My roommate is actually convinced he has a crush on me since those examples are wayyy more information than he gives anyone else.
How can I continue to hang out with him without those hang outs extending past 3 or 4 hours? I'm sure that if he comes to my apartment he'd spend a lot of time there. I'm not sure that I'd be very comfortable with going to his room.
Alternatively, how can I enforce a time limit on his visits without being mean or rude about it?