forked from sixpack/sixpack
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathCHANGES.rst
More file actions
1413 lines (1215 loc) · 56.6 KB
/
CHANGES.rst
File metadata and controls
1413 lines (1215 loc) · 56.6 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Changelog
=========
2.7.0 (2017-11-22)
------------------
------------
- Merge pull request #286 from dbillingham/master. [Zack Kitzmiller]
Add option to record forced experiment
- Converted record_force to bool. [Dan Billingham]
- Added api test for record force. [Dan Billingham]
- Add option to record forced experiment. [Dan Billingham]
- Merge pull request #283 from philipbjorge/patch-1. [Jose Diaz-
Gonzalez]
Use to_bool on bool env vars
- Use to_bool on bool env vars. [Philip Bjorge]
2.6.2 (2017-07-25)
------------------
Fix
~~~
- Check for NoneType. [Jose Diaz-Gonzalez]
Other
~~~~~
- Release version 2.6.2. [Jose Diaz-Gonzalez]
2.6.1 (2017-07-25)
------------------
Fix
~~~
- Be less cute about in-place logic. Closes #279. [Jose Diaz-Gonzalez]
Other
~~~~~
- Release version 2.6.1. [Jose Diaz-Gonzalez]
2.6.0 (2017-07-24)
------------------
- Release version 2.6.0. [Jose Diaz-Gonzalez]
- Merge pull request #256 from harmoney-dev/cors-enabled. [Jose Diaz-
Gonzalez]
Adding Flask-CORS
- Adding Flask-CORS. [Christopher Valles]
2.5.0 (2017-07-24)
------------------
- Release version 2.5.0. [Jose Diaz-Gonzalez]
- Merge pull request #266 from llonchj/master. [Jose Diaz-Gonzalez]
CORS for sixpack
- Merge branch 'master' into master. [Jose Diaz-Gonzalez]
- Fix to pass tests. [Jordi Llonch]
- Removed unused flask code. [Jordi Llonch]
- Fix doco. [Jordi Llonch]
- Fixed hiredis version. [Jordi Llonch]
- Bumped hiredis. [Jordi Llonch]
- Bumped gevent version. [Jordi Llonch]
- Added cors support. [Jordi Llonch]
2.4.1 (2017-07-05)
------------------
- Release version 2.4.1. [zackkitzmiller]
2.4.0 (2017-07-05)
------------------
Fix
~~~
- Use correct grep for checking repo status. [Jose Diaz-Gonzalez]
Other
~~~~~
- Release version 2.4.0. [zackkitzmiller]
- Merge pull request #271 from aldrinabastillas/readme-updates. [Zack
Kitzmiller]
Experiment names must be lowercase
- Experiment names must be lowercase. [Aldrin Abastillas]
Update participation endpoint argument
- Merge pull request #270 from wowair/proxy-fix. [Jose Diaz-Gonzalez]
add config to enable werkzeug ProxyFix middleware
- Add config to enable werkzeug ProxyFix middleware. [Steinn Steinsen]
- Merge pull request #262 from TomzxForks/add-secret-is-required-in-
sixpack-web-section-of-readme. [Jose Diaz-Gonzalez]
Add note to make explicit that secret is required, not optional for sixpack-web
- Add note in sixpack-web section that you need to specify a secret to
be able to access the website. [Tom Rochette]
- Merge pull request #263 from TomzxForks/bump-flask-assets-version-
to-0.12. [Jose Diaz-Gonzalez]
Bump Flask-Assets required version to 0.12
- [#260] Bump Flask-Assets required version to 0.12. Reorder
dependencies in alphabetical order. [Tom Rochette]
- Merge pull request #259 from foolusion/patch-1. [Jose Diaz-Gonzalez]
Update README.rst
- Update README.rst. [Andrew O'Neill]
- Merge pull request #255 from seatgeek/josegonzalez-patch-1. [Jose
Diaz-Gonzalez]
Drop --use-mirrors flag
- Drop --use-mirrors flag. [Jose Diaz-Gonzalez]
Refs #248
- Merge pull request #217 from seatgeek/ignorerobots. [Jose Diaz-
Gonzalez]
Catch the expirement error by moving the try/catch around
- Catch the expirement error by moving the try/catch around. [Evan
Carter]
- Add a note concerning the non-existence of test whitelisting. [Jose
Diaz-Gonzalez]
The design of sixpack was meant to allow easy integration of a/b testing into existing applications, thus we do not have any plans to integrate test whitelisting into the core.
- Merge pull request #200 from nickveenhof/real_archive. [Zack
Kitzmiller]
Add pause functionality so we can do actual archiving of the data
- Add pause functionality so we can do actual archiving of the data.
[nickveenhof]
Remove unarchive function
Remove debugging code
Adding some test coverage for the archive/pause methods
Covering the all method better
Increasing code coverage for the reset function
- Add release notes. [zackkitzmiller]
2.3.1 (2016-06-26)
------------------
- Bump version. [zackkitzmiller]
- Merge pull request #240 from seatgeek/cv-description-kpi. [Zack
Kitzmiller]
Add support for kpi descriptions
- Remove dump.rdb. [Chris Voll]
- Add support for kpi descriptions. [Chris Voll]
- Bump version. [zackkitzmiller]
- Merge pull request #239 from ShopRunner/atomic-experiment-creation.
[Zack Kitzmiller]
Ensure atomic experiment creation.
- Ensure atomic experiment creation. [Mark Williams]
The transaction wrapping the creation of experiment keys in
Experiment.save did not watch any of those keys. Consequently
parallel writers could cause duplicate writes against an
experiment's mutable values, such as its alternatives list.
This adds a watch guard to the experiment's key. Note that
Experiment.is_new_record now checks the existence of the
experiment's key rather than its membership in the experiments
set; this is so that the code watches a value unique to the
experiment and not one shared by all.
On conflict the experiment's traffic fraction is persisted.
- Merge pull request #231 from seatgeek/jc-update-benchmark-script.
[Zack Kitzmiller]
fixes to benchmark util's use of sixpack client
- Fixes to benchmark util's use of sixpack client. [Jon Coe]
- Prepare for 2.2.0. [zackkitzmiller]
- Merge pull request #225 from urbandictionary/add-stats. [Zack
Kitzmiller]
Add ability to send metrics to statsd
- Describe new options in README. [Igor Bondarenko]
- Use STATSD_URL instead of three separate vars. [Igor Bondarenko]
- Add tests for metrics. [Igor Bondarenko]
- Send metrics to statsd. [Igor Bondarenko]
Currently tracks:
- Number of calls to each endpoint
- Response time of each endpoint
- Number of responses by response code
- Add statsd config. [Igor Bondarenko]
- Merge pull request #214 from HeyHugo/fix-173. [Jose Diaz-Gonzalez]
Fix web UI chart loading issue
- Fix issue #173. [Hugo Heyman]
Handle experiment names with underscore the same way as they are rendered in template. See 'data-experiment' attribute in details.html template
- Merge pull request #207 from seatgeek/josegonzalez-patch-1. [Jose
Diaz-Gonzalez]
Pin gunicorn and gevent
- Pin gunicorn and gevent. [Jose Diaz-Gonzalez]
Tested in production with 17.5 and 19.4, working locally with a range of those versions.
- Update release script. [Jose Diaz-Gonzalez]
2.1.0 (2016-02-16)
------------------
- Release version 2.1.0. [Jose Diaz-Gonzalez]
- Fix restructured text issues in readme. [Jose Diaz-Gonzalez]
- Add release script. [Jose Diaz-Gonzalez]
- Merge pull request #206 from seatgeek/josegonzalez-patch-1. [Jose
Diaz-Gonzalez]
Add gunicorn and gevent
- Add gunicorn and gevent. [Jose Diaz-Gonzalez]
These don't need to be pegged to a specific version, and are confirmed working with gunicorn 17.5 through 19.4.1.
- Merge pull request #201 from danalloway/danalloway-patch-1. [Jose
Diaz-Gonzalez]
[bug] cast the environment variable to an integer
- Cast the environment variable to an integer. [Dan Alloway]
- Merge pull request #205 from johnbacon/patch-1. [Jose Diaz-Gonzalez]
Various improvements to README.rst
- Various improvements to README.rst. [John Bacon]
Consistency improvements throughout the README.
2.0.4 (2015-12-11)
------------------
- Update CHANGES.rst. [zackkitzmiller]
- Bump version. [zackkitzmiller]
- Merge pull request #204 from blackskad/configure-csrf-disable. [Zack
Kitzmiller]
Add a configuration value to disable csrf
- Add a config value to disable csrf. [Thomas Meire]
- Merge pull request #192 from nickveenhof/sixpack-191. [Zack
Kitzmiller]
allow traffic fraction to change in mid-flight
- Allow traffic fraction to change in mid-flight. [nickveenhof]
- Merge pull request #188 from seatgeek/josegonzalez-patch-1. [Jose
Diaz-Gonzalez]
Fix readme heading for 2.0.1
- Fix readme heading for 2.0.1. [Jose Diaz-Gonzalez]
- Merge pull request #193 from spjwebster/master. [Zack Kitzmiller]
Fix early bailout in existing_alternative for excluded clients
- Fix early bailout in existing_alternative for excluded clients. [Steve
Webster]
Also added an additional assert to the excluded client test that verifies excluded clients have no existing alternative even after a call to `Experiment.get_alternative`.
- Merge pull request #190 from seatgeek/fix-traffic-traction. [Zack
Kitzmiller]
[TRAFFIC] Fix over-recording
- [TRAFFIC] Fix over-recording. [zackkitzmiller]
- Merge pull request #174 from chaaaarlie/patch-1. [Zack Kitzmiller]
Remove round from choose alternative
- Remove round from choose alternative. [chaaaarlie]
Rounding the random number generated at choose_alternative is excluding users who happen to get a random number greater or equal to 0.990000.
- Merge pull request #157 from phjardas/check_traffic_fraction. [Zack
Kitzmiller]
Do not check traffic fraction for update on every participation.
- Added unit tests. [Philipp Jardas]
Redis database is now flushed after every test.
- Do not check traffic fraction for update on every participation.
[Philipp Jardas]
If a participation is requested without a traffic fraction argument, the traffic fraction is no longer assumed to be 1. This caused requests to always fail for experiments with a traffic fraction lower than 1 without explicit argument.
Further, the server no longer defaults the request parameter "traffic_fraction" to 1 but simply leaves it at None. It's up to the model to default this value to 1 only when creating an new experiment.
- Merge pull request #189 from seatgeek/josegonzalez-patch-2. [Zack
Kitzmiller]
Catch ValueError during g_stat calculation
- Catch ValueError during g_stat calculation. [Jose Diaz-Gonzalez]
There can be cases where the conversions for a given alternative are zero, resulting in a math domain error when taking the log of the value.
- Merge branch 'blackskad-issue-166' [zackkitzmiller]
- Merge branch 'issue-166' of https://github.com/blackskad/sixpack into
blackskad-issue-166. [zackkitzmiller]
Conflicts:
sixpack/test/experiment_model_test.py
- Discard conversions from excluded clients when traffic_fraction < 1.
[Thomas Meire]
When traffic_fraction is < 1, some clients get the control alternative.
The participations of these excluded clients are not recorded to redis.
When there is a conversion request for an excluded client, the conversion
is not discarded and recorded to redis. When there are a couple of these
conversions by excluded clients, the number of completed conversions
becomes bigger than the number of participants, which should never be
possible. The computation of the confidence_interval relies on this
assumption and fails when the completed_count becomes bigger than
participant_count.
The solution is to discard the conversions of excluded clients as well.
- Merge pull request #187 from nickveenhof/participating-typo. [Zack
Kitzmiller]
Fixing participating typo
- Fixing participating typo. [nickveenhof]
- Merge pull request #186 from blackskad/excluded-clients-on-dashboard.
[Zack Kitzmiller]
Display the number of clients that were excluded from the experiment on the dashboard.
- Bump fakeredis version to v0.4.0 for bitcount implementation. [Thomas
Meire]
- Display the number of clients that were excluded from the experiment.
[Thomas Meire]
- Merge pull request #185 from seatgeek/add-sixpack-java. [Zack
Kitzmiller]
Add sixpack-java to client list
- Add sixpack-java to list of clients. [Stephen D'Amico]
- Update license year to 2015. [Stephen D'Amico]
2.0.3 (2015-08-03)
------------------
- Bump version. [zackkitzmiller]
- Merge pull request #164 from marksteve/patch-1. [Zack Kitzmiller]
Port should be an integer
- Port should be an integer. [Mark Steve Samson]
- Merge pull request #137 from caxap/redis-max-connections. [Zack
Kitzmiller]
Added redis max connections setting.
- Added redis max connections setting. [Maxim Kamenkov]
- [TESTS] add coverage badge. [zackkitzmiller]
- [TESTS] try to add coveralls. [zackkitzmiller]
- [TESTS] try to add coveralls. [zackkitzmiller]
- Revert "[TESTS] try to add coveralls" [zackkitzmiller]
This reverts commit 7303d112ff906dbeb8664c982672d086370db3cf.
- [TESTS] try to add coveralls. [zackkitzmiller]
- [TESTS] try to add coveralls. [zackkitzmiller]
- Add coveralls. [zackkitzmiller]
- Merge pull request #156 from manjerico/patch-1. [Zack Kitzmiller]
Updated README.rst
- Updated README.rst. [Lino Silva]
Correct Facebook's Planout project file reference
2.0.2 (2015-08-03)
------------------
- Bump Version. [zackkitzmiller]
- [BUG] Fix broken experiments when winner is set. [zackkitzmiller]
- Merge pull request #153 from nderraugh/master. [Zack Kitzmiller]
added client
- Added client. [Neil Derraugh]
- Merge pull request #151 from seatgeek/naming-fixes. [Zach Sherman]
Naming fixes
- Remove logs. [Zachary Sherman]
- Santize names and fix charts. [Zachary Sherman]
- [WEB] uridecode experiment names. [Zachary Sherman]
- Merge pull request #149 from seatgeek/naming-fixes. [Zach Sherman]
sanitize names
- Remove log. [Zachary Sherman]
- Sanitize names. [Zachary Sherman]
- Add comment. [Zachary Sherman]
- Update copy. [Zachary Sherman]
2.0.1 (2015-08-03)
------------------
- Bump version. [Zachary Sherman]
- Error handline, url encoding, and new failing test section. [Zachary
Sherman]
- Merge pull request #134 from seatgeek/alt-choices. [Eric Waller]
Deterministic alternative choice
- Make this version 2.0-dev. [Eric Waller]
- Change record_participation arg to prefetch. [Eric Waller]
- Merge pull request #135 from caxap/fix-pipe-attr. [Zack Kitzmiller]
StrictRedis has no attribute 'pipe'.
- StrictRedis has no attribute 'pipe'. [Maxim Kamenkov]
- Merge pull request #126 from kadoppe/fix-experiments-json. [Zack
Kitzmiller]
Fix 500 error on experiments.json API
- Fix 500 error on experiments.json API. [kadoppe]
- Merge pull request #131 from ricksaenz/rs-display-traffic-fraction.
[Zack Kitzmiller]
display traffic fraction in UI
- Display traffic fraction in UI. [Rick Saenz]
- Merge pull request #133 from davidyell/patch-1. [Jose Diaz-Gonzalez]
Update README.rst
- Update README.rst. [David Yell]
Fixed a minor typo in the readme
2.0.0 (2015-08-03)
------------------
- [DOCS] update. [zackkitzmiller]
- Remove all multi-armed bandit code. [zackkitzmiller]
This was completely unnecessary, and overshadowed by the newer determinstic choice algorithm
- [TESTS] fix broken test, add test for failing traffic fraction.
[zackkitzmiller]
- Do no allow traffic fractions to be changed after an experiment has
started. [zackkitzmiller]
- Minor: save description on reset, closes #124. [zackkitzmiller]
- More tests for uniform choice. [zackkitzmiller]
- Add some comments on decisions made. [zackkitzmiller]
- Allow a no-record participation. [zackkitzmiller]
- Experiments endpoint. [zackkitzmiller]
- Kill unused code. [zackkitzmiller]
- Only use first 7 chars of UUID for deterministic algo.
[zackkitzmiller]
- Slim objectified methods. [zackkitzmiller]
- Kill client_chosen_alternative concept. [zackkitzmiller]
- Predictive alt selection, refs #132. [zackkitzmiller]
- [WEB] fix broken test from previous commit. [zackkitzmiller]
- [WEB] correctly format legacy dates, closes #130. [zackkitzmiller]
- [DELETEING] KPIs do not use a color as a separator, closes #110.
[zackkitzmiller]
- [UI] always show created at date. [zackkitzmiller]
closes #121
- [WEB] kill asset compression, closes #115. [zackkitzmiller]
- Merge pull request #122 from vslavik/master. [Zack Kitzmiller]
Fix insecure content warnings with HTTPS.
- Fix insecure content warnings with HTTPS. [Václav Slavík]
Change the fonts.googleapis.com link in layout.html to be protocol-relative.
This fixes insecure content warnings from modern browsers when running sixpack-web over HTTPS.
- Merge branch 'master' of github.com:seatgeek/sixpack. [zackkitzmiller]
- Merge pull request #120 from ainoya/fix-test-seed-method-args. [Zack
Kitzmiller]
sixpack/test/seed: fix find_or_create arguments
- Sixpack/test/seed: fix find_or_create arguments. [Naoki AINOYA]
- Closes #119. [Eric Waller]
The tests around sixpack-web aren't quite as good..
- Update README.rst. [Jack Groetzinger]
- Bump version. [zackkitzmiller]
- [INSTALLATION] don't put things in __init__.py. [zackkitzmiller]
This causes pip install to fail, as it imports sixpack before requirements are installed.
- Bump version. [zackkitzmiller]
- Fix parameter ordering. [zackkitzmiller]
- Closes #118. [Eric Waller]
- Start pulling out analysis code. [Eric Waller]
- Be consistent about using properties. [Eric Waller]
- Merge pull request #117 from seatgeek/python-api. [Eric Waller]
Refactor core logic into api.py
- Refactor core logic into api.py. [Eric Waller]
This has a few benefits:
* You can use sixpack within a python app with `sixpack.participate(...)`
* It's a bit easier to test
* It paves the way to add programmatically accessible analysis APIs which I'm thinking maybe a good way to address stuff like https://github.com/seatgeek/sixpack/pull/112
- Stop hiding the interesting data on mobile. [Eric Waller]
- Kill CSS file that was supposed to be removed in
eb1233267cf93eff848f32cfaa517050ff0133e2. [Eric Waller]
1.1.2 (2014-05-20)
------------------
- Bump version. [zackkitzmiller]
- Merge pull request #116 from seatgeek/client-chosen-alternative. [Zack
Kitzmiller]
Allow clients to choose an alternative
- Allow clients to choose an alternative. [Eric Waller]
Useful for situations where you may not know if a test will be encountered until it's too late to rely on asynchronously choosing an alternative.
For example, when testing the behavior of a button, if `participate` is called when the button is setup, users that never click the button will dilute the results, thus requiring more participations to reach significance.
- Merge pull request #106 from omenar/description-utf8. [Zack
Kitzmiller]
Add support to non-ascii characters on experiment description
- Handle None values returned by HGET. [Osvaldo Mena]
- Add support to non-ascii characters on experiment description.
[Osvaldo Mena]
- Throw error on casting float. [zackkitzmiller]
1.1.1 (2014-02-05)
------------------
- Bump version. [zackkitzmiller]
- Update changes. [zackkitzmiller]
- Add newline at the end of config.py. [Osvaldo Mena]
- Add Support for Redis Sentinel. [Osvaldo Mena]
Support for Redis Sentinel using redis.sentinel.SentinelConnectionPool. Can be configured either by specifiying the env vars SIXPACK_CONFIG_REDIS_SENTINEL_SERVICE_NAME and SIXPACK_CONFIG_REDIS_SENTINELS, or by specifying redis_sentinel_service_name and redis_sentinels on config.yml
- Bump version. [zackkitzmiller]
1.1.0 (2014-01-20)
------------------
- [DOCS] add CHANGES.rst. [zackkitzmiller]
- Merge branch 'develop' [zackkitzmiller]
- [WEB] export should respect kpi. [zackkitzmiller]
- Document multi-armed bandit. [zackkitzmiller]
Closes #89
- Merge pull request #100 from seatgeek/traffic-dist-refactor. [Zack
Kitzmiller]
revisit traffic distribution/fraction
- Revisit traffic distribution/fraction. [zackkitzmiller]
closes #99
- Merge branch 'master' of https://github.com/hsinhoyeh/sixpack into
develop. [zackkitzmiller]
- Add ZeroDivisionError exception to avoid fatal error on calculating
g_stat. [hsinhoyeh]
- Support settings via env variables. [zackkitzmiller]
closes #98
- Merge branch 'no-yaml' of https://github.com/CypherSystems/sixpack
into CypherSystems-no-yaml. [zackkitzmiller]
- Type convertions from enviroment strings. [Otoniel Plahcinski]
- Fix testing to have no default config file. [Otoniel Plahcinski]
- Concept Code. [Otoniel Plahcinski]
- Document multi-armed bandit. [zackkitzmiller]
Closes #89
- Link iOS client. [Jose Diaz-Gonzalez]
- Added sixpack client library for iOS. [Jose Diaz-Gonzalez]
- Merge pull request #97 from b10m/master. [Zack Kitzmiller]
Added a Perl client package
- Added a Perl client package. [B10m]
1.0.5 (2013-10-16)
------------------
- Merge remote-tracking branch 'origin/master' [zackkitzmiller]
- Merge pull request #94 from bnadlerjr/patch-1. [Zack Kitzmiller]
Fix typo in README.
- Fix typo in README. [Bob Nadler]
- Bump version. [zackkitzmiller]
- Allow KPI conversion after non-KPI conversion. [zackkitzmiller]
closes seatgeek/sixpack#95
1.0.4 (2013-09-12)
------------------
- Bump version. [zackkitzmiller]
- Merge pull request #92 from seatgeek/fix-missing-setup. [Zack
Kitzmiller]
manifest: Fix missing setup.py
- Manifest: Fix missing setup.py. [Philip Cristiano]
The setup.py isn't in the package and wasn't being included
- Merge pull request #87 from dhrrgn/master. [Zack Kitzmiller]
find_or_404 should only catch ValueError.
- Find_or_404 should only catch ValueError. [Dan Horrigan]
By catching all errors it makes it very hard to debug. For example, if
the Redis service craps out in the middle of the request, a 404 will be
returned instead of a 500, which means the exception will be silently
ignored, and not being logged correctly.
- Merge pull request #85 from subosito/sixpack-go. [Zack Kitzmiller]
Add Go client library
- Typo. [Alif Rachmawadi]
- Add sixpack-go. [Alif Rachmawadi]
- Merge pull request #88 from dhrrgn/ascii-fix. [Zack Kitzmiller]
Fixing the ASCII art. Very Important of course.
- Fixing the ASCII art. Very Important of course. [Dan Horrigan]
- Merge pull request #86 from dhrrgn/master. [Eric Waller]
Removing uneeded markdown() call.
- Removing uneeded markdown() call. [Dan Horrigan]
- Merge pull request #84 from dhrrgn/master. [Zack Kitzmiller]
Simplifying the debug check.
- Simplifying the debug check. [Dan Horrigan]
1.0.1 (2013-08-29)
------------------
- Bump version. [zackkitzmiller]
- Move third party js and css libraries to vendor folder.
[zackkitzmiller]
this should change the github language statistics
1.0.0 (2013-08-29)
------------------
- Bump version. [zackkitzmiller]
- Change error message. [zackkitzmiller]
- Merge pull request #83 from jeremiak/patch-1. [Zack Kitzmiller]
Update README.rst
- Update README.rst. [Jeremia Kimelman]
Updating to include Redis required versions
- Add ability to turn off debug mode and add necessary notes to readme.
[zackkitzmiller]
- All responses should be json. [zackkitzmiller]
- Dont throw a backtrace on start if Redis is not available.
[zackkitzmiller]
- Add note about removing experiment code. [zackkitzmiller]
- Make confusing documentation more clear. [zackkitzmiller]
- Disable MAB by default. [zackkitzmiller]
- Less confusing behavior when there are no experiments.
[zackkitzmiller]
- Kill unnecessary comment. [zackkitzmiller]
- Rename style.css to sixpack.css to be consistent with javascript
files. [zackkitzmiller]
- Update flask, werkzeug to latest versions. [zackkitzmiller]
- Updates to readme. [zackkitzmiller]
- Merge branch 'master' of github.com:seatgeek/sixpack. [zackkitzmiller]
- Trivial language tweak. [Jack Groetzinger]
- Add 's' to experiment/ urls. [zackkitzmiller]
- Tests for multiple KPIs, fix bugs found with tests, refs #30.
[zackkitzmiller]
- Invalid KPIs should throw exceptions on /convert on the server.
[zackkitzmiller]
- Alternative names, experiments, and KPIs cannot have spaces.
[zackkitzmiller]
- Exclude webassets cache. [zackkitzmiller]
- Merge pull request #78 from seatgeek/multiple-kpis. [Zack Kitzmiller]
Multiple kpis
- Updated KPI dropdown bar. Probably still sucks in browsers that aren't
chrome or safari though. [Chris Voll]
- Fix for undefined js bug. [zackkitzmiller]
- Redirect when KPI is selected, refs #30. [zackkitzmiller]
- Auto select correct KPI on dropdown. [zackkitzmiller]
- Add current kpi to .json responses. [zackkitzmiller]
- Pass KPI value through javascript back to server, refs #30.
[zackkitzmiller]
- Initial implementation of multiple KPIs in sixpack-web, refs #30.
[zackkitzmiller]
- Hookup multiple KPI conversion to /convert action in server, refs #30.
[zackkitzmiller]
- Add handling in models to allow for multiple KPIs, refs #30.
[zackkitzmiller]
- Update KEYSPACE to allow for multiple KPIs, refs #30. [zackkitzmiller]
- Fix broken dashboard, expects list of names. [zackkitzmiller]
- No longer load in archived experiments and hide them with javascript.
[zackkitzmiller]
- Add _status endpoint to sixpack-web closes #77. [zackkitzmiller]
- Refactor response handling, refs #77. [zackkitzmiller]
- Actually fix showing archived experiments on dashboard.
[zackkitzmiller]
- Fix. [zackkitzmiller]
- Do not load archived experiments then hide them on the dashboard,
closes #72. [zackkitzmiller]
- Do not load archived experiments then hide them on the dashboard,
closes #72. [zackkitzmiller]
- Fixed another confidence interval bug. [Chris Voll]
- Merge pull request #71 from seatgeek/confidence-interval. [Zack
Kitzmiller]
Fixed confidence interval boxplot bug for large datasets, new welcome page
- Some improvements to welcome page. [Chris Voll]
- Better bug fix. [Chris Voll]
- Fixed confidence interval boxplot bug for large datasets, new welcome
screen. [Chris Voll]
- RST is not MD. [zackkitzmiller]
- Add note about hiredis install errors, thanks @taylorotwell.
[zackkitzmiller]
- Bump version. [zackkitzmiller]
- Select traffic distribution for experiments, closes #29.
[zackkitzmiller]
- Change order of imports. [zackkitzmiller]
- Adjust keyspace to allow for excluded clients, refs #29.
[zackkitzmiller]
- Merge pull request #70 from seatgeek/confidence-interval. [Zack
Kitzmiller]
Added 80% confidence intervals, some other minor enhancements
- Implemented confidence interval boxplots. [Chris Voll]
- Reduced confidence interval to one decimal. [Chris Voll]
- Added 80% confidence intervals, some other minor enhancements. [Chris
Voll]
- Merge pull request #69 from seatgeek/responsive-charts. [Zack
Kitzmiller]
Dashboard charts are now responsive
- Navigation UI improvements. [Chris Voll]
- Retina logo. [Chris Voll]
- Responsive description modal. [Chris Voll]
- Better responsiveness for chart dots on details page, better narrow
width. [Chris Voll]
- Dashboard charts are now responsive. [Chris Voll]
- Merge pull request #68 from seatgeek/issue-56. [Eric Waller]
Fixed long variation name alignment, fixes #56
- Fixed long variation name alignment, fixes #56. [Chris Voll]
- Not sure how that stray = got in there. [Chris Voll]
- Details page icons. [Chris Voll]
- Removed focus hackery. [Chris Voll]
- Merge pull request #66 from seatgeek/copy-querystring. [Zack
Kitzmiller]
Copy querystring to clipboard
- Final cleanup. [Chris Voll]
- Added zeroclipboard to details pages to copy querystrings. [Chris
Voll]
- Merge pull request #65 from seatgeek/dots. [Zack Kitzmiller]
UI Updates, Dots, Tooltips
- Adjusted table position. Unfortunately, negative right margin wasn't
working, so the fix just removed the negative margins altogether.
[Chris Voll]
- Added responsive charts to details pages. [Chris Voll]
- Added dot color to tooltip. [Chris Voll]
- Removed leading zeros, ref #52. [Chris Voll]
- Smaller dots for lots of data. [Chris Voll]
- Fixed earlier bug, moved a couple styles around. [Chris Voll]
- Final tooltip touches. [Chris Voll]
- Added tooltips. [Chris Voll]
- Initial dots implementation, no tooltip yet. [Chris Voll]
- UI updates, responsiveness, created better workarounds for a Chrome
bug, new colors, updated nav. [Chris Voll]
- Fix json template for dashboard. [zackkitzmiller]
- Remove artificial limitation on markdown implementation, refs #61 and
#64. [zackkitzmiller]
- Allow paragraph tags with markdown. [zackkitzmiller]
- Check that description exists before trying to parse with markdown,
refs #64. [zackkitzmiller]
- Merge branch 'markdown' [zackkitzmiller]
- Add limited markdown support to descriptions, closes #64.
[zackkitzmiller]
- Initial markdown implementation for experiment descriptions, refs #64.
[zackkitzmiller]
- Remove unnecessary comment. [zackkitzmiller]
- Add experiments.json endpoint. [zackkitzmiller]
- Add method to retrieve only archived experiments. [zackkitzmiller]
- Fix merge conflict. [zackkitzmiller]
- Resolve merge conflict. [zackkitzmiller]
- Fix merge conflict. [zackkitzmiller]
- Bump version. [zackkitzmiller]
- Remove the entire concept of 'versions' from sixpack. [zackkitzmiller]
- Merge branch 'master' into kill-versions. [zackkitzmiller]
- Modify keyspace to remove concept of experiment "versions"
[zackkitzmiller]
- Bump version. [zackkitzmiller]
- Rename script.js to sixpack.js. [zackkitzmiller]
- More sahne archive UI, closes #51. [zackkitzmiller]
- Kill unnecessary comment. [zackkitzmiller]
- Bump version. [zackkitzmiller]
- Add experiment to export filename download. [zackkitzmiller]
- Bump version. [zackkitzmiller]
- Add ability to export experiment details to csv. [zackkitzmiller]
- Whitespace. [zackkitzmiller]
- Fix potentially devastating bug related to deleted experiments.
[zackkitzmiller]
- Add .vfenv to .gitignore. [zackkitzmiller]
- Fix broken graphs on versioned experiments. [zackkitzmiller]
- Remove unused var. [zackkitzmiller]
- Pep8. [zackkitzmiller]
- Better idea: everything uses 'test statistic' nomenclature, agnostic
to specific test stat used. [Steve Ritter]
- Details uses g_stat. [Steve Ritter]
- Dashboard uses g_stat. [Steve Ritter]
- Changed objectify to use g_stat. [Steve Ritter]
- Formatting. [Steve Ritter]
- Added g test for confidence level to replace hacky undocumented z
score. [Steve Ritter]
- Fixes #53 - details page graph alignment and size. [Matthew Hudson]
- Fixing close button styling - closes #54. [Matthew Hudson]
- Remove unused allow_multiple_experiments option. [Eric Waller]
- Remove unused control_on_db_failure option. [Eric Waller]
- Remove unused full_response option. [Eric Waller]
- Fix robot detection (with tests) [Eric Waller]
- Merge pull request #50 from seatgeek/issue-43. [Matthew Hudson]
Graph hover states. Closes #43
- Sort chart lines so the active line is "above" the non-hovered lines.
[Matthew Hudson]
- Removing chart tooltip. [Matthew Hudson]
- Adding support for chart/circle highlighting. [Matthew Hudson]
- Adjusting table-line highlighting behavior. [Matthew Hudson]
- Enabling chart hover states based on table interaction. [Matthew
Hudson]
- Adding some helpful comments. [Matthew Hudson]
- Fixing experiment alternative highlighting. [Matthew Hudson]
- Adding hover state to chart lines. [Matthew Hudson]
- Basic build out for enabling chart hover state. [Matthew Hudson]
- Dont use == to compare with False. [zackkitzmiller]
- Fixing x-axis chart bug. [Matthew Hudson]
- Fixing details page header styling. [Matthew Hudson]
- Fixing update description default value. [Matthew Hudson]
- Details page experiment name doesn't need to be a link. [Matthew
Hudson]
- 'Update Description' button should allow you to update an existing
description. [Matthew Hudson]
Closes #45
- Merge branch 'master' of github.com:seatgeek/sixpack. [Matthew Hudson]
- Merge pull request #47 from seatgeek/enable-whiplash. [Zack
Kitzmiller]
make MAB not the default and change the config option for it
- Make MAB not the default and change the config option for it. [Jose
Diaz-Gonzalez]
- Adjusting dashboard page chart positioning. [Matthew Hudson]
- Optimixing x-axis tick spacing. [Matthew Hudson]
- Adding x-axis labels to charts. [Matthew Hudson]
- Update client spec to include forcing alternatives. [zackkitzmiller]
- Fix duplicate conversions in by-period data. [Eric Waller]
- Test for the by-period conversion data. [Eric Waller]
- Fix experiment version caching. [Eric Waller]
- Kill unused property. [Eric Waller]
- Cache sequential ids again. [Eric Waller]
- Sequential ids are stored per experiment. [Eric Waller]
This will prevent memory usage from growing uncontrollably for conversion/participations keys. It also means that memory can be fully reclaimed when experiments are deleted.
- Whitespace. [Eric Waller]
- Rename get_alternative_by_client_id. [Eric Waller]
- Control is a property. [Eric Waller]
- Kill unused collection models. [Eric Waller]
- Whitespace. [Eric Waller]
- Fix _get_stats. [Eric Waller]
- Test conversion. [Eric Waller]
- Shorten key names to conform w/ updated CLIENTSPEC. [Eric Waller]
- Lua implementation of get_alternative_by_client_id. [Eric Waller]
and delete the unused has_converted_by_client_id
- Use a shorter default prefix. [Eric Waller]
- Update KEYSPACE to specify short key names. [Eric Waller]
computers don't care
- Merge pull request #42 from seatgeek/spinner-fix. [Eric Waller]
Fixes a bug that causes the spinner to load infinitely.
- Fixes a bug that causes the spinner to load infinitely. [Matthew
Hudson]
- Merge branch 'develop' [Eric Waller]
- Add a quick benchmark script. [Eric Waller]
This could be extended a good deal. The main thing I want to add is the ability to generate data for a couple of days at a time.
Note, it uses a modified version of the client with the module name changed to sixpack_client, b/c otherwise it conflicts with the server module.
- Reduce redis queries for participate from 13 to 7. [Eric Waller]
(6 to 3 for bots)
- Merge pull request #41 from seatgeek/develop. [Eric Waller]
Eliminate a number of extra redis requests
- Duplicate conversions aren't exceptional. [Eric Waller]
- Experiment.winner is now a cached property. [Eric Waller]
- Re-order alternative choosing precedence. [Eric Waller]
New precedence ordering:
* The force param
* If the server is not enabled, the control is returned
* If there's a winner, it's returned
* If the visitor is excluded, return the control
* Otherwise create an internal client_id and return a "chosen" alternative
This ensures the following:
* Bots do not cause internal client_ids to be created
* Bots *do* get the winner if one exists
* The force param *always* works
* Redis work is minimized
- Fix bug with returning the winner. [Eric Waller]
- Remove extra Experiment.find. [Eric Waller]
- Added default background-color to prevent FOUC. [Matthew Hudson]
- Remove duplicative conversion rate with bad formatting.
[zackkitzmiller]
During a merge conflict, the proper formatting of the conversion rate was removed from the .json experiment endpoints.
- Commas. [zackkitzmiller]
- Revert super agressive preloading. [zackkitzmiller]
- Merge branch 'js-templating' [zackkitzmiller]
- Build out ajax templates for charts and dashboards. [Matthew Hudson]
- Better response for conversion rate in json endpoint. [zackkitzmiller]
- More info on alternative .json endpoint. [zackkitzmiller]
- More comprehensive .json endpoint. [zackkitzmiller]
- Merge pull request #39 from seatgeek/dashboard-improvements. [Matthew
Hudson]
Only load Dashboard charts when scrolled into the viewport.
- Merged master. [Matthew Hudson]
- Merge branch 'master' of github.com:seatgeek/sixpack. [zackkitzmiller]
- Compress, do not just concatconcatenate assets. [zackkitzmiller]
- Compress, do not just concatenate assets. [zackkitzmiller]
- Better formatting. [zackkitzmiller]
- Fade-in Dashboard charts on-scroll. [Matthew Hudson]
- Load Dashboard charts on scroll. [Matthew Hudson]
- Added $.waypoints plugin. [Matthew Hudson]
- Don't include boostrap.js twice. [zackkitzmiller]
- Merge pull request #37 from seatgeek/develop2. [Zack Kitzmiller]
Allow datetime for record/participate to be specified in the respective urls
- Add .webassets-cache to gitignore. [Eric Waller]
- Allow datetime to be specified by clients. [Eric Waller]
- Merge pull request #38 from seatgeek/chart-improvements. [Matthew
Hudson]
Dashboard + Detail charts are now cumulative. Closes #36
- Higher-resolution data in charts. [Matthew Hudson]
- Removed legacy JS. [Matthew Hudson]
- Transitioned selector language to use chart instead of graph. [Matthew
Hudson]
- Removed legacy code. [Matthew Hudson]
- Dashboard graphs are now cumulative. [Matthew Hudson]
- Revert "Revert "bump version"" [zackkitzmiller]
This reverts commit c6121a5a45057625ebf9880f3a49e71c8595c9b3.
- Revert "maybe this" [zackkitzmiller]
This reverts commit b7cbd1a384627b63b9d4b9a98a248eacb62fa58c.
- Revert "bump version" [zackkitzmiller]
This reverts commit 100ed05fe390588a9da646de86af90e6491b623b.
- Maybe this. [zackkitzmiller]
- Bump version. [zackkitzmiller]
- Märk control alt as such. [zackkitzmiller]
- Change default host to 0.0.0.0 for dev mode. [zackkitzmiller]
- Add .json endpoints to sixpack-web for experiments. [zackkitzmiller]
- Move error templates, add 500 error page. [zackkitzmiller]
- Added asset_path to readme. [zackkitzmiller]
- 404 page. [zackkitzmiller]
- Line break. [zackkitzmiller]
- Kill debug. [zackkitzmiller]
- Configurable asset path. [zackkitzmiller]
- Add empty folder. [zackkitzmiller]
- Update all references to config.yml to <path to config.yml>
[zackkitzmiller]
- Merge branch 'master' of github.com:seatgeek/sixpack. [zackkitzmiller]
- Readme: Fix numbering of steps. [Philip Cristiano]
- Readme: Fix seed example command. [Philip Cristiano]
The command requires a PYTHONPATH in order to find the models. Also
since this is in the development section it should follow the pattern
of the other example commands which include the local config.yml
instead of instruction to replace with the path to the config file.
- Enable debug. [zackkitzmiller]
- Fix git whoops. [zackkitzmiller]
- Revert "Merge branch 'compress-assets'" [zackkitzmiller]
This reverts commit 5cd51272ef6e505e35626e1e144976a22c05af88, reversing
changes made to 40e784c3140992ab9040f550a1a553cd7185146d.
- Merge branch 'compress-assets' [zackkitzmiller]
- More css. [zackkitzmiller]
- Remove unnecessary css. [zackkitzmiller]
- Bundle the css. [zackkitzmiller]
- First go at compressing all assets, refs #20. [zackkitzmiller]
- This list should actually be reversed. [zackkitzmiller]
- Attempt to find a matching variation of a experiment if it exists.
[zackkitzmiller]
This will avoid the issue of dozens of tests being created when switching back and forth between two sets are alternatives for the same experiment.
- Bump version. [zackkitzmiller]
- Allow to view old version results. [zackkitzmiller]
- Enable/disable six-pack server level, closes #33. [zackkitzmiller]
- Faster dashboard, use redis pipelining when possible. [zackkitzmiller]
- Fixed graphs. [Matthew Hudson]
- Turned off the archive toolbar when there isn't any experiment data.
[Matthew Hudson]
- Updated readme for sixpack web. [zackkitzmiller]
- Fix broken test, whoops. [zackkitzmiller]
- Fixed template bug that reversed the position of name and description.
[Matthew Hudson]
- Merge branch 'master' of github.com:seatgeek/sixpack. [zackkitzmiller]
Conflicts:
sixpack/templates/dashboard.html
- Better description handling. [zackkitzmiller]
- Better description handling. [zackkitzmiller]