NumberFormatException on a date value

[cwdcwd]

This is likely on one of the created/updated timestamp fields

Error message:

Error: MapperParsingException[failed to parse [createdAt]]; nested: NumberFormatException[For input string: "9/12/18 11:21 AM"]; 

example payload causing the error:

{ message: 
{ topic: 'member.action.profile.trait.create',
'mime-type': 'application/json',
originator: 'ap-member-microservices',
timestamp: '2018-09-12T11:21:09.017Z',
payload: 
{ userId: 40669741,
userHandle: 'mayank.gupta18',
traitId: 'communities',
categoryName: 'Communities',
createdAt: '9/12/18 11:21 AM',
updatedBy: 40672021,
traits: [Object],
createdBy: 40672021,
updatedAt: '9/12/18 11:21 AM' } } }```

[cwdcwd]

ES Processor-Bugs

[zsudraco]

I think this may be because there are inconsistent field values,
some previous createdAt value may be milliseconds value, then elastic search maps it to number field type;
then later if a date string is passed, ES will fail to parse it to number.

I think we may fix it by either:
(1) remove createdAt/updatedAt fields, if they are not necessary
(2) re-set the createdAt/updatedAt fields by the processor code, so that their field values are consistent date string.

Which do you like, or other approach ?

[zsudraco]

Or
(3) when we see number type createdAt/updatedAt, convert them to date string, so that field type is consistent

[urwithat]

Option 3 sounds fine, but are we certain that createdAt/updatedAt are in fact integers.

[zsudraco]

I will do some check, if (_.isNumber(...)) then convert it to ISO date string: new Date(...).toISOString()

[urwithat]

Sure

[urwithat]

Any updates

[zsudraco]

My last pull request has made the changes as above discussion.
I.e. when createdAt/updatedAt is number, it will be converted to ISO date string.
To test new code, the Elasticsearch index should be re-created.

[dedywahyudi]

@urwithat @cwdcwd
This the related PR:
#6

[dedywahyudi]

@zsudraco Sorry delay, your payment should be released for this fixes:
http://www.topcoder.com/challenge-details/30072457/?type=develop