I am not seeing this behavior.
When I set a date filter to a fixed range of 1-JUN-14 to 1-JUN-16 and then use a Time Component with the axis label set to YYYY (year only), each year's tickets are grouped correctly (see image below). 2014, 2015, and 2016 appear because the date range includes records found in each of those years. 2014 shows records between 1-JUN-14 and 31-DEC-14, 2015 shows records between 1-JAN-2015 and 31-DEC-2015, and 2016 shows records between 1-JAN-2016 and 1-JUN-2016. This is exactly what I would expect.
Are you doing something different from what I just described? Can you include screenshots of the title bar of the record lists when you do a View Records for any/each of those bars in the yearly bar graph?