I would like to change how we send logs to logstash so each log message is stored as an individual document. To make this more practical, we need to add some more meta data to each message so we can properly filter them. I suggest adding the following:

instance_start_time: An ISO_INSTANT time stamp string indicating when this JVM instance was started.
work_id: A running counter generated ID for each work item, rest request or periodic check, which was previously clumped up in one log message.
work_item: For work items, store the item toString()

By combining these in different ways, we get a very powerful way of filtering log messages in Kibana to help drill down when looking for problems.