Bot to include previous messages in newly raised ticket

Is it possible to get the Bot to attach recent conversation threads from the user prior to submitting the ticket when the ticket is raised via API? Currently, we have “the last two user utterances and the last two Copilot responses are shared with the agent at the start of the session” but this doesnt seem to accurately track conversation. I think it would be helpful if, when a new ticket is logged, the conversation the user had with the bot is included in the comments or description if it is relevant to the nature of their request