Is it possible to access Session values of all the online clients from the server
Yes. What that way is will depend on the session library you are using, but it is certainly possible.
It would be simpler to mark items as reserved in your main database when you add them to someone's cart though. Session data is for data private to the user, not for global data.
is there a way through which if a person closes the browser without making order
There is no way to reliably detect if the browser has been closed. Even if it has, then the user might have another window on the same site which isn't closed.
The usual basic approach to solving this is to reserve the item for a certain amount of time when it is added to the basket. You can tell the user how much time they have. This is an approach commonly used by theatres with reserved seating.
Your seats will be reserved for 20 minutes. If you do not complete your order in that time, they may be released and someone else may reserve them.
A slightly more complex approach would be to extend the reservation time whenever the user (identified by the session) interacts with the site. You might want to do this if people are browsing the site and buying multiple items.
You can clean up old reservations (which have expired) using a cron job.