The usergrid object triggers the paginator in djiblets to turn on alphabetic queries by providing a current_letter parameter to the DataGrid. 

If there is no letter parameter passed into query string it defaults to 'A'. 

The users_list function (in views) is reponsible for catching a letter parameter in the query string (including catching and throwing errors), and filtering the queryset accordingly (ie. filter for names starting with 'A') before passing it to the datagrid.
I've provided a screenshot of what the paginator looks like and am open to suggestions about making CSS modifications. I've also tried out Andrew Hongs suggestions of adding brackets around the numeric buttons. 

Manually tested button behaviour of first last, next and back arrows.
Unit tests for the user list are updated to test new features and all pass. 
All unit tests pass.