The get message API, Gmail API to fetch particular email, doesn't returns modified time of email. Modified time should change whenever someones reads an email. Also there is a field called 'Date' which is return as part of 'payload.headers[].name'. What does this value indicates? From my testing it stores sent/received time of emails.
Use case: WebDav clients expects modified time for legal hold policies.
Reference: https://developers.google.com/gmail/api/v1/reference/users/messages/get