Why is MSMQ faster than WCF QueueService?

Question

I have self-hosted WCF service in console with netNamedPipeBinding binding. The service has just one empty method Send(DataTable bulk)

[ServiceContract]
public interface IWcfQueueService
{
    [OperationContract]
    void Send(DataTable bulk);       
}
public class WcfQueueService : IWcfQueueService
{
    public void Send(DataTable bulk)
    {           
       // Here would be something like _bulks.Add(bulk);
       // BUT, for now it is empty method and still it's slower than MSMQ
    }    
}

My client gets 200K inputs from DB and process it with our BoundedThreadPool(only creates, let say, 20 threads). Each input is processed with different thread. Each thread executes MyMethod and in the end of MyMethod the result is added to bulkManager.

public void MyMethod(string input)
{            
    var res = ProcessInput(input);
    bulkManager.Add(res);
}

When bulkManager accumulates N items (=bulk) it pass the bulk to another thread that all it does is enqueue that bulk with one of two methods:

If wcf enabled: wcfQueueService.Send(bulk);
else if MSMQ enabled: new MessageQueue(@".\private$\q").Send(new Message {Body = bulk});

All two methods works, but MSMQ works much more faster. With MSMQ client manages to process about 80K bulks in 20seconds while with wcf only 20K-30K bulks. I don't understand why it happens. My WCF runs in different process like MSMQ does. In addition, my WCF doesn't stores anything, it has empty method. So why MSMQ wins WCF?

Updated

As leppie suggested I tried .NetRemoting. NetRemoting indeed improved the speed. The client processed 60K. But,

It's still slower than MSMQ
As I read .Net Remoting is deprecated by WCF and WCF should be faster than .Net Remoting according to this, so why I get that my wcf is slower? Maybe my binding is wrong?

You will probably find remoting is a lot faster than MSMQ (given named pipes, I assume IPC on the local machine). — leppie
@leppie, .Net Remoting indeed improved the speed. The client processed 60K. But, 1 - it's still slower than MSMQ and 2- as I read .Net Remoting is deprecated by WCF and WCF should be faster than .Net Remoting according to msdn.microsoft.com/en-us/library/…, so why I get that my wcf is slower? — theateist
@theateist: Can you change your InstanceContextMode on the service to Single and ConcurrencyMode to Multiple? Then do another test. Also try to adjust the throttling settings (in the service behavior). — Marcel N.
@theateist: WCF only 'replaces' .NET remoting in non-IPC scenarios. WCF is disconnect by nature while remoting is 'mostly connected'. .NET remoting will NEVER die! :) — leppie
@leppie: Come on, man... What are you talking about? It's already dead :). — Marcel N.

Chris Dickson Chris Dickson · Accepted Answer · 2012-07-22T12:15:59

You are not comparing like with like.

The most obvious difference is that in the WCF case your timings include execution of the entire service-side channel stack and operation invocation, whereas your direct MSMQ case only measures the time to enqueue the payload on the client side. Bear in mind that the service side processing in WCF includes deserialization of your DataTable object, which is probably quite expensive if your bulking factor N is large.

What is more, depending on how you have configured your service instancing and throttling knobs, the requests from the client may be being made more quickly than the service is configured to handle, resulting in the requests themselves being queued for execution on the service side.

Also, depending on how you have configured your binding, there may be other significant differences, security for example. By the way, did you really use NetNamedPipeBinding (as your question states) rather than NetMsmqBinding as the title seemed to imply? If so, using the default binding configuration you will have totally unnecessary encryption and signing of each Bulk message going on, which isn't happening in your direct MSMQ case. These cryptographic operations on large messages will be relatively expensive also.

A better comparison would be with the WCF operation defined as OneWay.

Why is MSMQ faster than WCF QueueService?

3 Answers