I might be wrong but it sounds like the issue with the target framework setting on your project:
for Castle.Windsor to work it has to be set to .NET Framework 4
rather than to .NET Framework 4 Client Profile
.
You can configure it by opening project properties, tab Application (in Visual studio) or just editing the project file.
If that's about the version of the package after all, then usually using NuGet you can append a flag install-package Castle.Windsor -version 2.5.3
to specify which one to install, but I couldn't find any options there when it comes to Castle.LoggingFacility
.