【问题标题】:SQL Message Broker leaving messages in Sending QueueSQL Message Broker 将消息留在发送队列中
【发布时间】:2015-08-27 21:57:20
【问题描述】:

我们通过表上的触发器将消息放入 SQL Server 消息队列。 (当字段更新时,我们构建一些 XML,并调用下面的触发器)。

CREATE PROCEDURE [dbo].[up_CarePay_BrokerSendXml] 
    -- Add the parameters for the stored procedure here
    @Data VARCHAR(MAX) 

AS
BEGIN

    DECLARE @InitDlgHandle UNIQUEIDENTIFIER
    DECLARE @RequestMessage VARCHAR(1000) 
    BEGIN TRY
          BEGIN TRAN

                BEGIN DIALOG CONVERSATION @InitDlgHandle 
                FROM SERVICE [//IcmsCarePay/Service/Initiator]
                TO SERVICE N'//IcmsCarePay/Service/Target'
                ON CONTRACT [//IcmsCarePay/Contract]
                WITH ENCRYPTION = OFF;

                SEND ON CONVERSATION @InitDlgHandle
                MESSAGE TYPE [//IcmsCarePay/Message/Request] (@Data);

          COMMIT TRAN;
    END TRY
    BEGIN CATCH
          ROLLBACK TRAN;
          DECLARE @Message VARCHAR(MAX);
          SELECT @Message = ERROR_MESSAGE();
          PRINT @Message
    END CATCH;

END

这行得通。一条消息被放入队列中。

然后将消息发送到同一服务器上的接收队列 - 不同的数据库。然后我们每分钟运行一次 proc,它从目标队列中抓取消息,并将其处理到临时表中进行处理。然后消息从目标队列中移出,这一切都没有错误。

不过……

当我检查消息来自的发起者队列时,它正在填满消息。

SELECT TOP 1000 *, casted_message_body = 
CASE message_type_name WHEN 'X' 
  THEN CAST(message_body AS NVARCHAR(MAX)) 
  ELSE message_body 
END 
FROM [ICMS].[dbo].[IcmsCarePayInitiatorQueue] WITH(NOLOCK)

我原以为当消息从发起者传到目标时,发起者会消失。但它似乎正在填满。

我注意到发起者中的消息的“message_type_id”为 2,“验证”为“E”,消息正文和强制转换的消息正文为 NULL。都有一个 message_type_name 'http://schemas.microsoft.com/SQL/ServiceBroker/EndDialog'。

在目标数据库端,这是用于从队列中获取消息的过程:

CREATE PROCEDURE [dbo].[up_CarePayBrokerReceiveXml]   
AS
BEGIN  
  SET NOCOUNT ON;  

  DECLARE @XML XML, @Response XML = 'OK', @ConversationHandle UNIQUEIDENTIFIER, @message_type_name SYSNAME, @message_body VARBINARY(MAX), @source_table VARCHAR(100)
  DECLARE @Message VARCHAR(MAX), @Line INT, @Proc VARCHAR(MAX), @Exception VARCHAR(MAX)  

  WHILE ( 1 = 1 )
  BEGIN  
    -- Clear variables, as they may have been populated in previous loop.
    SET @message_type_name = NULL
    SET @message_body = NULL
    SET @ConversationHandle = NULL  
    SET @source_table = NULL

    BEGIN TRY 
      BEGIN TRAN

        WAITFOR (    -- Pop off a message at a time, and add to storage table.
           RECEIVE TOP (1) 
               @message_type_name = message_type_name  
             , @message_body = message_body  
             , @ConversationHandle = conversation_handle  
             , @source_table = CAST([message_body] AS XML).value('(/row/@SourceTable)[1]', 'varchar(50)')  
           FROM dbo.IcmsCarePayTargetQueue  
        ), TIMEOUT 3000;  

        IF @@ROWCOUNT = 0
        BEGIN  
          ROLLBACK  -- Complete the Transaction (Rollback, as opposeed to Commit, as there is nothing to commit).
          BREAK  
        END

        -- Code removed for example, but the fields are saved to a staging table in the database here...

         -- Respond to Initiator  
        SEND ON CONVERSATION @ConversationHandle MESSAGE TYPE [//IcmsCarePay/Message/Response](@Response);  
        END CONVERSATION @ConversationHandle;  

      COMMIT -- End of Transaction

    END TRY
    BEGIN CATCH
      -- End the conversation
      END CONVERSATION @ConversationHandle WITH CLEANUP  

      -- Get details about the issue.
      SELECT  @Exception = ERROR_MESSAGE(), @Line = ERROR_LINE(), @Proc = ERROR_PROCEDURE(), @Message = 'proc: ' + @Proc + '; line: ' + CAST(@Line AS VARCHAR) + '; msg: ' + @Exception  
      SELECT  @Message -- Displays on Concole when debugging.

      -- Log the issue to the Application Log.
      INSERT  INTO dbo.ApplicationLog
              ( LogDate ,
                Thread ,
                Level ,
                Logger ,
                Message ,
                Exception  
              )
      VALUES  ( GETDATE() , -- LogDate - datetime  
                'None' , -- Thread - varchar(255)  
                'FATAL' , -- Level - varchar(50)  
                '____up_CarePayBrokerReceiveXml' , -- Logger - varchar(255)  
                @Message , -- Message - varchar(4000)  
                @Exception  -- Exception - varchar(2000)  
              )  
      COMMIT -- We have stored the erronous message, and popped it off the queue. Commit these changes.
    END CATCH 
  END  -- end while  

END

为什么这些消息会保留在那里?

保留在 Initiator 队列中的消息的详细信息是:

Status: 1
Priority: 5
queuing_order: 395
mess_sequence_number: 0
service_name: //IcmsCarePay/Service/Initiator
service_contract_name: //IcmsCarePay/Contract
message_type_name: http://schemas.microsoft.com/SQL/ServiceBroker/EndDialog
message_type_id: 2
validation: E
message_body: NULL
casted_message_body: NULL

【问题讨论】:

    标签: sql-server sql-server-2008 service-broker


    【解决方案1】:

    您似乎在这些对话中使用一次性对话。您的目标存储过程从目标队列中检索消息,然后关闭它们的对话框,但您不在启动器队列上处理它。

    由于对话是一个分布式的东西,为了关闭它,它必须在发起方和目标方都关闭。当您的目标 proc 在目标上发出 end conversation @Handle; 时,Service Broker 会将您提到的类型的消息发送给发起者,通知它这个特定的对话是历史。

    正确完成后,启动程序激活程序将收到此消息,在其一侧发出相应的end conversation,并关闭对话框。

    由于您在发起方不处理任何消息,因此这些系统消息会在那里累积。

    这里有两种可能的解决方案:

    1. 处理EndDialog 消息。这实际上应该在两侧完成,因为对话框可以在其任一侧关闭。
    2. 重复使用对话框,这样您就不必在每次需要发送内容时都创建一个新对话框。它将节省一些重要的资源,尤其是在流量足够大的情况下。

    请注意,无论您将使用持久性对话还是一次性对话,都应完成 #1。

    编辑:这是一个默认处理过程的示例,取自我的一个项目:

    create procedure [dbo].[ssb_Queue_DefaultProcessor]
    (
        @Handle uniqueidentifier,
        @MessageType sysname,
        @Body xml,
        @ProcId int
    ) with execute as owner as
    
    set nocount, ansi_nulls, ansi_padding, ansi_warnings, concat_null_yields_null, quoted_identifier, arithabort on;
    set numeric_roundabort, xact_abort, implicit_transactions off;
    
    declare @Error int, @ErrorMessage nvarchar(2048);
    
    declare @Action varchar(20);
    
    begin try
    
    -- System stuff
    if @MessageType in (
        N'http://schemas.microsoft.com/SQL/ServiceBroker/EndDialog',
        N'http://schemas.microsoft.com/SQL/ServiceBroker/Error'
        ) begin
    
        -- Depending on the actual message, action type will be different
        if @MessageType = N'http://schemas.microsoft.com/SQL/ServiceBroker/EndDialog' begin
            set @Action = 'PURGE';
        end else if @MessageType = N'http://schemas.microsoft.com/SQL/ServiceBroker/Error'
            set @Action = 'CLOSE';
    
        -- Close the dialog
        exec dbo.ssb_DialogPools_Maintain @Action = @Action, @DialogHandle = @Handle, @Error = @Error output, @ErrorMessage = @ErrorMessage output;
    
        if nullif(@Error, 0) is not null
            throw 50000, @ErrorMessage, 1;
    
    end else
        -- Some unknown messages may end up here, log them
        throw 50011, 'Unknown message type has been passed into default processor.', 1;
    
    end try
    begin catch
    
    if nullif(@Error, 0) is null
        select @Error = error_number(), @ErrorMessage = error_message();
    
    -- Don't try to resend messages from default processing
    exec dbo.ssb_Poison_Log @ErrorNumber = @Error, @ErrorMessage = @ErrorMessage, @MessageType = @MessageType, @MessageBody = @Body, @ProcId = @ProcId;
    
    end catch;
    return;
    

    当他们遇到任何类型的消息而不是他们应该处理的消息时,它会从所有激活过程中调用。 以下是此类激活过程之一的示例:

    create procedure [dbo].[ssb_QProcessor_Clients]
    with execute as owner as
    
    
    set nocount, ansi_nulls, ansi_padding, ansi_warnings, concat_null_yields_null, quoted_identifier, arithabort on;
    set numeric_roundabort, xact_abort, implicit_transactions off;
    
    declare @Handle uniqueidentifier, @MessageType sysname, @Body xml, @MessageTypeId int;
    declare @Error int, @ErrorMessage nvarchar(2048), @ProcId int = @@procid;
    declare @TS datetime2(4), @Diff int, @Delay datetime;
    
    
    -- Fast entry check for queue contents
    if not exists (select 0 from dbo.ssb_OY_Clients with (nolock))
        return;
    
    while exists (select 0 from sys.service_queues where name = 'ssb_OY_Clients' and is_receive_enabled = 1) begin
    
        begin try
        begin tran;
    
        -- Receive something, if any
        waitfor (
            receive top (1) @Handle = conversation_handle,
                @MessageType = message_type_name,
                @Body = message_body
            from dbo.ssb_OY_Clients
        ), timeout 3000;
    
        if @Handle is null begin
    
            -- Empty, get out
            rollback;
            break;
    
        end;
    
        -- Check for allowed message type
        select @MessageTypeId = mt.Id
        from dbo.ExportMessageTypes mt
            inner join dbo.ExportSystems xs on xs.Id = mt.ExportSystemId
        where mt.MessageTypeName = @MessageType
            and xs.Name = N'AUDIT.OY.Clients';
    
        if @MessageTypeId is not null begin
    
            -- Store the data
            exec dbo.log_Clients @MessageType = @MessageType, @Body = @Body, @Error = @Error output, @ErrorMessage = @ErrorMessage output;
    
            -- Check the result
            if nullif(@Error, 0) is not null
                throw 50000, @ErrorMessage, 1;
    
        end else
            -- Put it into default processor
            exec dbo.ssb_Queue_DefaultProcessor @Handle = @Handle, @MessageType = @MessageType, @Body = @Body, @ProcId = @ProcId;
    
        commit;
        end try
        begin catch
    
        if nullif(@Error, 0) is null
            select @Error = error_number(), @ErrorMessage = error_message();
    
        -- Check commitability of the transaction
        if xact_state() = -1
            rollback;
        else if xact_state() = 1
            commit;
    
        -- Try to resend the message again
        exec dbo.[ssb_Poison_Retry] @MessageType = @MessageType, @MessageBody = @Body, @ProcId = @ProcId, @ErrorNumber = @Error, @ErrorMessage = @ErrorMessage;
    
        end catch;
    
        -- Reset dialog handle
        select @Handle = null, @Error = null, @ErrorMessage = null;
    
    end;
    
    -- Done!
    return;
    

    当然,在这个示例中它比您可能需要的要多一些,但我希望一般方法是显而易见的。并且您需要在启动器和目标上处理 EndDialogError 消息类型,因为您永远不知道它们会出现在哪里。

    【讨论】:

    • 谢谢@RogerWolf - 我想选择选项 1。我不是 100% 确定你所说的“处理 EndDialog 消息”是什么意思。上述程序是否需要该代码?
    • 我已经修改了问题以显示接收方的阅读过程。
    • @Craig:不要在发送之后立即结束发起者的对话。是一个糟糕的反模式,请参阅rusanu.com/2006/04/06/… 我敦促您在IcmsCarePayInitiatorQueue 上添加正确处理消息。 Activated Procedure 可以做到。
    • @Craig,这意味着为发起者队列创建一个(激活)存储过程,接收这些 EndDialog 消息并为其对话发出end conversation。我敦促你听听 Remus - 对话应该由使用它们的最后一方关闭,在你的情况下,它是发起者。此外,with cleanup 是一个非常危险的想法 - 您可能会突然意外地开始丢失数据。错误登录到单独的表将是一个更好的选择。
    • @Craig,刚刚更新了答案,以展示这个想法,但你已经明白了,似乎:)
    猜你喜欢
    • 2014-04-16
    • 2015-08-15
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多