DeadLetterQueueSourceArn missing while receiving message from DLQ

[jgchoppe]

Hey!

I'm currently using your awesome tool to test AWS SQS queues locally.
The goal of my architecture would be to have SQS queues with a DeadLetters Queue.
I'm able to pull messages from the DLQ, However DeadLetterQueueSourceArn is missing from the attributes.

Example with AWS SQS:

{
    "Messages": [
        {
            "MessageId": "************************************",
            "ReceiptHandle": "*****",
            "MD5OfBody": "*****",
            "Body": "example",
            "Attributes": {
                "SenderId": "*********************",
                "ApproximateFirstReceiveTimestamp": "1701176294398",
                "ApproximateReceiveCount": "8",
                "SentTimestamp": "1701176278493",
                "SequenceNumber": "18882245240547823616",
                "MessageDeduplicationId": "************************************",
                "MessageGroupId": "test",
                "DeadLetterQueueSourceArn": "arn:aws:sqs:us-west-2:*****:example.fifo"
            }
        }
    ]
}

Example with ElasticMQ:

{
    "Messages": [
        {
            "MessageId": "************************************",
            "ReceiptHandle": "************************************#************************************",
            "MD5OfBody": "e4b3b7558956e56fcb6b5397bdc6523d",
            "Body": "example",
            "Attributes": {
                "ApproximateFirstReceiveTimestamp": "1701176081533",
                "SentTimestamp": "1701175918154",
                "MessageDeduplicationId": "************************************",
                "SenderId": "*********",
                "ApproximateReceiveCount": "6",
                "MessageGroupId": "test",
                "SequenceNumber": "0"
            }
        }
    ]
}

It would be great if this attribute could be added when the message is moved to the DLQ.

[micossow]

Fixed in v1.5.8
Thanks for reporting the issue!

[sergij]

Hi!

It seems that the fix provided in #985 is not completely accurate, as according to AWS SQS specifications attribute DeadLetterQueueSourceArn should be provided with the message that is retrieved from the dead letter queue after it was forwarded there from the source queue, and the meaning of this attribute is to provide link to the original queue where the message was sent to, not where the message should go after exhausting maxReceiveCount attempts.

Looking at #985, test to be passed should look something like:

  test("should return DeadLetterQueueSourceArn in receive DLQ message attributes") {
    // given
    val messageBody = "Message 1"
    val createDlqQueueResult = client.createQueue(new CreateQueueRequest("testDlq")).getQueueUrl
    val redrivePolicy = RedrivePolicy("testDlq", awsRegion, awsAccountId, 1).toJson.toString

    val createQueueResult = client
      .createQueue(
        new CreateQueueRequest("main")
          .withAttributes(
            Map(redrivePolicyAttribute -> redrivePolicy).asJava
          )
      )
      .getQueueUrl

    // when
    client.sendMessage(createQueueResult, messageBody)
    // all we need to achieve here is to trigger move message to dead letter queue
    client.receiveMessage(
      new ReceiveMessageRequest()
        .withQueueUrl(createQueueResult)
        .withAttributeNames("All")
    )
    // data we are looking for should be coming with a message received from DLQ
    val receiveDlqResult = client.receiveMessage(
      new ReceiveMessageRequest()
        .withQueueUrl(createDlqQueueResult)
        .withAttributeNames("All")
    )

    // then
    receiveDlqResult.getMessages.asScala.toList.flatMap(_.getAttributes.asScala.toList) should contain(
      ("DeadLetterQueueSourceArn", s"arn:aws:sqs:$awsRegion:$awsAccountId:main")
    )
  }

[micossow]

I'll check this

[sergij]

Thank you @micossow! Just for reference I prepared this change set: #1086

It is not very clean as it makes messageSystemAttributes mutable in order to store "sourceQueue" metadata, but on high level it achieves what is required.

[micossow]

Released in v1.6.11