forked from apache/mesos
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathCHANGELOG
2757 lines (2492 loc) · 165 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Release Notes - Mesos - Version 0.29.0 (WIP)
--------------------------------------------
This release contains the following new features:
* [MESOS-4909] - Tasks can now specify a kill policy. They are best-effort,
because machine failures or forcible terminations may occur. Currently, the
only available kill policy is how long to wait between graceful and forcible
task kill. In the future, more policies may be available (e.g. hitting an
HTTP endpoint, running a command, etc). Note that it is the executor's
responsibility to enforce kill policies. For executor-less command-based
tasks, the kill is performed via sending a signal to the task process:
SIGTERM for the graceful kill and SIGKILL for the forcible kill. For docker
executor-less tasks the grace period is passed to 'docker stop --time'. This
feature supersedes the '--docker_stop_timeout', which is now deprecated.
* [MESOS-4949] - The executor shutdown grace period can now be configured in
`ExecutorInfo`, which overrides the agent flag. When shutting down an
executor the agent will wait in a best-effort manner for the grace period
specified here before forcibly destroying the container. The executor must
not assume that it will always be allotted the full grace period, as the
agent may decide to allot a shorter period and failures / forcible
terminations may occur. Together with kill policies this gives frameworks
flexibility around how to clean up tasks and executors.
Deprecations:
* [MESOS-2281] - Deprecated the plain text format for credentials in favor of
the JSON format.
* [MESOS-5001] - The 'allocator/event_queue_dispatches' metric is now
deprecated in favor 'of allocator/mesos/event_queue_dispatches'.
Additional API Changes:
* [MESOS-4735] - Add 'filename' field to CommandInfo.URI in Scheduler API
and v1 Scheduler HTTP API.
* [MESOS-5014] - Changes Call and Event Type enums in scheduler.proto
from required to optional for the purpose of backwards compatibility.
* [MESOS-5015] - Changes Call and Event Type enums in executor.proto
from required to optional for the purpose of backwards compatibility.
Release Notes - Mesos - Version 0.28.0
--------------------------------------------
This release contains the following new features:
* [MESOS-4343] - A new cgroups isolator for enabling the net_cls subsystem in
Linux. The cgroups/net_cls isolator allows operators to provide network
performance isolation and network segmentation for containers within a Mesos
cluster. To enable the cgroups/net_cls isolator, append `cgroups/net_cls` to
the `--isolation` flag when starting the slave. Please refer to
docs/mesos-containerizer.md for more details.
* [MESOS-4687] - The implementation of scalar resource values (e.g., "2.5
CPUs") has changed. Mesos now reliably supports resources with up to three
decimal digits of precision (e.g., "2.501 CPUs"); resources with more than
three decimal digits of precision will be rounded. Internally, resource math
is now done using a fixed-point format that supports three decimal digits of
precision, and then converted to/from floating point for input and output,
respectively. Frameworks that do their own resource math and manipulate
fractional resources may observe differences in roundoff error and numerical
precision.
* [MESOS-4479] - Reserved resources can now optionally include "labels".
Labels are a set of key-value pairs that can be used to associate metadata
with a reserved resource. For example, frameworks can use this feature to
distinguish between two reservations for the same role at the same agent
that are intended for different purposes.
* [MESOS-2840] - **Experimental** support for container images in Mesos
containerizer (a.k.a. Unified Containerizer). This allows frameworks to
launch Docker/Appc containers using Mesos containerizer without relying on
docker daemon (engine) or rkt. The isolation of the containers is done using
isolators. Please refer to docs/container-image.md for currently supported
features and limitations.
* [MESOS-4793] - **Experimental** support for v1 Executor HTTP API. This
allows executors to send HTTP requests to the /api/v1/executor agent
endpoint without the need for an executor driver. Please refer to
docs/executor-http-api.md for more details.
* [MESOS-4370] Added support for service discovery of Docker containers that
use Docker Remote API v1.21.
Additional API Changes:
* [MESOS-4066] - Agent should not return partial state when a request is made to /state endpoint during recovery.
* [MESOS-4547] - Introduce TASK_KILLING state.
* [MESOS-4712] - Remove 'force' field from the Subscribe Call in v1 Scheduler API.
* [MESOS-4591] - Change the object of ReserveResources and CreateVolume ACLs to `roles`.
* [MESOS-3583] - Add stream IDs for HTTP schedulers.
* [MESOS-4427] - Ensure ip_address in state.json (from NetworkInfo) is valid
All Issues:
** Bug
* [MESOS-1187] - precision errors with allocation calculations
* [MESOS-1469] - No output from review bot on timeout
* [MESOS-2007] - AllocatorTest/0.SlaveReregistersFirst is flaky
* [MESOS-2017] - Segfault with "Pure virtual method called" when tests fail
* [MESOS-3273] - EventCall Test Framework is flaky
* [MESOS-3397] - sorter.cpp: Check failed: total.resources.contains(slaveId)
* [MESOS-3413] - Docker containerizer does not symlink persistent volumes into sandbox
* [MESOS-3570] - Make Scheduler Library use HTTP Pipelining Abstraction in Libprocess
* [MESOS-3719] - Core dump on /teardown
* [MESOS-3725] - shared library loading depends on environment variable updates
* [MESOS-3833] - /help endpoints do not work for nested paths
* [MESOS-3940] - /reserve and /unreserve should be permissive under a master without authentication.
* [MESOS-4029] - ContentType/SchedulerTest is flaky.
* [MESOS-4047] - MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery is flaky
* [MESOS-4071] - Master crash during framework teardown ( Check failed: total.resources.contains(slaveId))
* [MESOS-4249] - Mesos fetcher step skipped with MESOS_DOCKER_MESOS_IMAGE flag
* [MESOS-4255] - Add mechanism for testing recovery of HTTP based executors
* [MESOS-4285] - Mesos command task doesn't support volumes with image
* [MESOS-4291] - fs::enter(rootfs) does not work if 'rootfs' is read only.
* [MESOS-4298] - Sync up configuration.md and flags.cpp
* [MESOS-4338] - Create utilities for common shell commands used.
* [MESOS-4370] - NetworkSettings.IPAddress field is deprecated in Docker
* [MESOS-4383] - Support docker runtime configuration env var from image.
* [MESOS-4395] - Add persistent volume endpoint tests with no principal
* [MESOS-4416] - Get the perf version function return fail
* [MESOS-4427] - Ensure ip_address in state.json (from NetworkInfo) is valid
* [MESOS-4454] - Create common sha512 compute utility function.
* [MESOS-4478] - ReviewBot seemed to be crashing ReviewBoard server when posting large reviews
* [MESOS-4484] - GMock warning in MasterTest.OrphanTasks
* [MESOS-4495] - Delete `os::chown` on Windows
* [MESOS-4496] - Replace `glob` on Windows with something more suited to the platform
* [MESOS-4499] - Docker provisioner store should reuse existing layers in the cache.
* [MESOS-4517] - Introduce docker runtime isolator.
* [MESOS-4542] - MasterQuotaTest.AvailableResourcesAfterRescinding is flaky.
* [MESOS-4546] - Mesos Agents needs to re-resolve hosts in zk string on leader change / failure to connect
* [MESOS-4555] - Build broken with GCC 5.3.0
* [MESOS-4556] - ShasumTest.SHA512SimpleFile failed on centos7.
* [MESOS-4562] - Mesos UI shows wrong count for "started" tasks
* [MESOS-4563] - Docker::Container::Create should handle NetworkSettings.IPAddress being an empty string.
* [MESOS-4570] - DockerFetcherPluginTest.INTERNET_CURL_FetchImage seems flaky.
* [MESOS-4573] - Design doc for scheduler HTTP Stream IDs
* [MESOS-4583] - Rename `examples/event_call_framework.cpp` to `examples/test_http_framework.cpp`
* [MESOS-4584] - Update Rakefile for mesos site generation
* [MESOS-4585] - mesos-fetcher LIBPROCESS_PORT set to 5051 URI fetch failure
* [MESOS-4587] - Docker environment variables must be able to contain the equal sign
* [MESOS-4591] - `/reserve` and `/create-volumes` endpoints allow operations for any role
* [MESOS-4597] - `freebsd.hpp` is missing from the release tarball
* [MESOS-4598] - Logrotate ContainerLogger should not remove IP from environment.
* [MESOS-4602] - Invalid usage of ATOMIC_FLAG_INIT in member initialization
* [MESOS-4614] - SlaveRecoveryTest/0.CleanupHTTPExecutor is flaky
* [MESOS-4615] - ContainerLoggerTest.DefaultToSandbox is flaky
* [MESOS-4619] - Remove markdown files from doxygen pages
* [MESOS-4637] - Docker process executor can die with agent unit on systemd.
* [MESOS-4639] - Posix process executor can die with agent unit on systemd.
* [MESOS-4640] - Logrotate container logger can die with agent unit on systemd.
* [MESOS-4656] - strings::split behaves incorrectly when n=1
* [MESOS-4661] - SlaveRecoveryTest/0.ReconnectHTTPExecutor is flaky
* [MESOS-4669] - Add common compression utility
* [MESOS-4670] - `cgroup_info` not being exposed in state.json when ComposingContainerizer is used.
* [MESOS-4671] - Status updates from executor can be forwarded out of order by the Agent.
* [MESOS-4674] - Linux filesystem isolator tests are flaky.
* [MESOS-4675] - Cannot disable systemd support
* [MESOS-4676] - ROOT_DOCKER_Logs is flaky.
* [MESOS-4677] - LimitedCpuIsolatorTest.ROOT_CGROUPS_Pids_and_Tids is flaky.
* [MESOS-4681] - Updated libnl3 download links
* [MESOS-4683] - Document docker runtime isolator.
* [MESOS-4693] - Variable shadowing in HookManager::slavePreLaunchDockerHook
* [MESOS-4703] - Make Stout configuration modular and consumable by downstream (e.g., libprocess and agent)
* [MESOS-4711] - Race condition in libevent poll implementation causes crash
* [MESOS-4714] - "make DESTDIR=<path> install" broken
* [MESOS-4743] - Mesos fetcher not working correctly on docker apps on CoreOS
* [MESOS-4747] - ContainerLoggerTest.MesosContainerizerRecover cannot be executed in isolation
* [MESOS-4768] - MasterMaintenanceTest.InverseOffers is flaky
* [MESOS-4774] - Wrong symbolic link of some Mesos libraries
* [MESOS-4784] - SlaveTest.MetricsSlaveLaunchErrors test relies on implicit blocking behavior hitting the global metrics endpoint
* [MESOS-4806] - LevelDBStateTests write to the current directory
* [MESOS-4824] - "filesystem/linux" isolator does not unmount orphaned persistent volumes
* [MESOS-4825] - Master's slave reregister logic does not update version field
* [MESOS-4830] - Bind docker runtime isolator with docker image provider.
* [MESOS-4831] - Master sometimes sends two inverse offers after the agent goes into maintenance.
* [MESOS-4832] - DockerContainerizerTest.ROOT_DOCKER_RecoverOrphanedPersistentVolumes exits when the /tmp directory is bind-mounted
* [MESOS-4833] - Poor allocator performance with labeled resources and/or persistent volumes
* [MESOS-4836] - Fix rmdir for windows
* [MESOS-4866] - Added document for overlayfs backend.
* [MESOS-4888] - Default cmd is executed as an incorrect command.
* [MESOS-4903] - Allow multiple loads of module manifests
** Documentation
* [MESOS-1471] - Document replicated log design/internals
* [MESOS-3831] - Document operator HTTP endpoints
* [MESOS-4376] - Document semantics of `slaveLost`
* [MESOS-4377] - Document units associated with resource types
* [MESOS-4452] - Improve documentation around roles, principals, authz, and reservations
* [MESOS-4622] - Update configuration.md with `--cgroups_net_cls_primary_handle` agent flag.
* [MESOS-4702] - Document default value of "offer_timeout"
* [MESOS-4786] - Example in C++ style guide uses wrong indention for wrapped line
* [MESOS-4854] - Update CHANGELOG with net_cls isolator
* [MESOS-4873] - Add documentation about container image support.
** Epic
* [MESOS-4343] - Introduce the ability to assign network handles to mesos containers
* [MESOS-4793] - Executor API v1
** Improvement
* [MESOS-197] - Executor sendStatusUpdate should ACK on slave checkpoint
* [MESOS-2585] - Use full width for mesos div.container
* [MESOS-2971] - Implement OverlayFS based provisioner backend
* [MESOS-3608] - Optionally install test binaries.
* [MESOS-4004] - Support default entrypoint and command runtime config in Mesos containerizer
* [MESOS-4005] - Support workdir runtime configuration from image
* [MESOS-4169] - MasterMaintenanceTest.InverseOffers is slow
* [MESOS-4225] - Exposed docker/appc image manifest to mesos containerizer.
* [MESOS-4261] - Remove docker auth server flag
* [MESOS-4333] - Refactor Appc provisioner tests
* [MESOS-4344] - Allow operators to assign net_cls major handles to mesos agents
* [MESOS-4479] - Implement reservation labels
* [MESOS-4486] - Speed up FetcherCacheTest.Local* test cases
* [MESOS-4487] - Introduce status() interface in `Containerizer`
* [MESOS-4488] - Define a CgroupInfo protobuf to expose cgroup isolator configuration.
* [MESOS-4489] - The `cgroups/net_cls` isolator needs to expose handles in the ContainerStatus
* [MESOS-4490] - Get container status information in slave.
* [MESOS-4493] - Add ability to create symlink on Windows
* [MESOS-4494] - Implement `size`, `usage`, and other disk metrics reporting on Windows.
* [MESOS-4497] - Add ZK to the Windows agent build
* [MESOS-4498] - Refactor os.hpp to be less monolithic, and more cross-platform compatible
* [MESOS-4520] - Introduce a status() interface for isolators
* [MESOS-4523] - Enable benchmark tests in ASF CI
* [MESOS-4547] - Introduce TASK_KILLING state.
* [MESOS-4551] - process::collect() and process::await only take a fixed number of arguments (when not using a list).
* [MESOS-4552] - Help strings are not removed from the global help process upon process termination.
* [MESOS-4564] - Separate Appc protobuf messages to its own file.
* [MESOS-4566] - Avoid unnecessary temporary `std::string` constructions and copies in `jsonify`.
* [MESOS-4571] - SlaveRecoveryTest.RecoverStatusUpdateManager is not consistent with its description
* [MESOS-4575] - Fix Appc image caching to share with image fetcher
* [MESOS-4588] - Set title for documentation webpages.
* [MESOS-4618] - Speed up FetcherCacheTest.SimpleEviction
* [MESOS-4628] - Speed up FetcherCache test cases by reduce allocation_interval.
* [MESOS-4636] - Add parent hook to subprocess.
* [MESOS-4657] - Add LOG(INFO) in `cgroups/net_cls` for debugging allocation of net_cls handles.
* [MESOS-4667] - Expose persistent volume information in HTTP endpoints
* [MESOS-4685] - Speed up FetcherCache test cases by disable framework checkpoint.
* [MESOS-4710] - Add comment about labels caveats to mesos.proto
* [MESOS-4731] - Update /frameworks to use jsonify
* [MESOS-4776] - Libprocess metrics/snapshot endpoint rate limiting should be configurable.
* [MESOS-4783] - Disable rate limiting of the global metrics endpoint for mesos-tests execution
* [MESOS-4792] - Remove src/common/date_utils.{c,h}pp
* [MESOS-4796] - Debug ability enhancement for unified container
** Task
* [MESOS-1940] - Add Mesos-graced/hosted libraries to installation path
* [MESOS-3339] - Implement filtering mechanism for (Scheduler API Events) Testing
* [MESOS-3424] - Support fetching AppC images into the store
* [MESOS-3525] - Figure out how to enforce 64-bit builds on Windows.
* [MESOS-3583] - Introduce stream IDs in HTTP Scheduler API
* [MESOS-3613] - Port slave/paths.cpp to Windows
* [MESOS-3643] - Implement stout/os/windows/shell.hpp
* [MESOS-3763] - Need for http::put request method
* [MESOS-3929] - Automate the process of landing commits for committers
* [MESOS-3943] - Support dynamic weight in allocator
* [MESOS-4066] - Agent should not return partial state when a request is made to /state endpoint during recovery.
* [MESOS-4200] - Test case(s) for weights + allocation behavior
* [MESOS-4345] - Implement a network-handle manager for net_cls cgroup subsystem
* [MESOS-4358] - Expose net_cls network handles in agent's state endpoint
* [MESOS-4421] - Document that /reserve, /create-volumes endpoints can return misleading "success"
* [MESOS-4433] - Implement a callback testing interface for the Executor Library
* [MESOS-4435] - Update `Master::Http::stateSummary` to use `jsonify`.
* [MESOS-4438] - Add 'dependency' message to 'AppcImageManifest' protobuf.
* [MESOS-4439] - Fix appc CachedImage image validation
* [MESOS-4457] - Implement tests for the new Executor library
* [MESOS-4531] - Document multi-disk support.
* [MESOS-4590] - Add test case for reservations with same role, different principals
* [MESOS-4596] - Add common Appc spec utilities.
* [MESOS-4660] - Document net_cls isolator in docs/mesos-containerizer.md.
* [MESOS-4686] - Implement master failover tests for the scheduler library.
* [MESOS-4691] - Add a HierarchicalAllocator benchmark with reservation labels.
* [MESOS-4700] - Allow agent to configure net_cls handle minor range.
* [MESOS-4707] - Add fs:supported() function for detecting whether a file system is supported
* [MESOS-4712] - Remove 'force' field from the Subscribe Call in v1 Scheduler API
* [MESOS-4713] - ReviewBot should not fail hard if there are circular dependencies in a review chain
* [MESOS-4746] - CMake: Add leveldb library to 3rdparty external builds.
* [MESOS-4748] - Add Appc image fetcher tests.
* [MESOS-4780] - Remove `user` and `rootfs` flags in Windows launcher.
* [MESOS-4798] - Make existing scheduler library tests use the callback interface.
* [MESOS-4817] - Remove internal usage of deprecated *.json endpoints.
* [MESOS-4822] - Add support for local image fetching in Appc provisioner.
* [MESOS-4829] - Remove `grace_period_seconds` field from Shutdown event v1 protobuf.
* [MESOS-4834] - Add 'file' fetcher plugin.
Release Notes - Mesos - Version 0.27.2
--------------------------------------
* This is a bug fix release.
** Bug
* [MESOS-4693] - Variable shadowing in HookManager::slavePreLaunchDockerHook.
* [MESOS-4711] - Race condition in libevent poll implementation causes crash.
* [MESOS-4754] - The "executors" field is exposed under a backwards incompatible schema.
** Improvement
* [MESOS-4687] - Implement reliable floating point for scalar resources.
Release Notes - Mesos - Version 0.27.1
--------------------------------------
* This is a bug fix release.
** Bug
* [MESOS-4546] - Mesos Agents needs to re-resolve hosts in zk string on leader change / failure to connect.
* [MESOS-4563] - Docker::Container::Create should handle NetworkSettings.IPAddress being an empty string.
* [MESOS-4582] - state.json serving duplicate "active" fields.
* [MESOS-4585] - mesos-fetcher LIBPROCESS_PORT set to 5051 URI fetch failure.
* [MESOS-4587] - Docker environment variables must be able to contain the equal sign.
* [MESOS-4597] - `freebsd.hpp` is missing from the release tarball.
* [MESOS-4598] - Logrotate ContainerLogger should not remove IP from environment.
* [MESOS-4637] - Docker process executor can die with agent unit on systemd.
* [MESOS-4639] - Posix process executor can die with agent unit on systemd.
* [MESOS-4640] - Logrotate container logger can die with agent unit on systemd.
* [MESOS-4675] - Can not disable systemd support.
** Improvement
* [MESOS-4566] - Avoid unnecessary temporary `std::string` constructions and copies in `jsonify`.
* [MESOS-4636] - Add parent hook to subprocess.
** Task
* [MESOS-4435] - Update `Master::Http::stateSummary` to use `jsonify`.
* [MESOS-4531] - Document multi-disk support.
Release Notes - Mesos - Version 0.27.0
--------------------------------------------
** API Changes:
* [MESOS-313] - Report executor termination to framework schedulers.
* [MESOS-2315] - Removed deprecated CommandInfo::ContainerInfo.
* [MESOS-3988] - Implicit roles.
* [MESOS-4154] - Rename shutdown_frameworks to teardown_frameworks.
** Bug
* [MESOS-934] - 'Logging and Debugging' document is out-of-date.
* [MESOS-1613] - HealthCheckTest.ConsecutiveFailures is flaky
* [MESOS-2209] - Mesos should not use negative exit codes
* [MESOS-2768] - SIGPIPE in process::run_in_event_loop()
* [MESOS-3134] - Port bootstrap to CMake
* [MESOS-3151] - ReservationTest.CompatibleCheckpointedResourcesWithPersistentVolumes is flaky
* [MESOS-3235] - FetcherCacheHttpTest.HttpCachedSerialized and FetcherCacheHttpTest.HttpCachedConcurrent are flaky
* [MESOS-3307] - Configurable size of completed task / framework history
* [MESOS-3349] - Removing mount point fails with EBUSY in LinuxFilesystemIsolator.
* [MESOS-3379] - LinuxFilesystemIsolatorTest.ROOT_VolumeFromHostSandboxMountPoint is failed
* [MESOS-3472] - RegistryTokenTest.ExpiredToken test is flaky
* [MESOS-3479] - COMMAND Health Checks are not executed if the timeout is exceeded
* [MESOS-3551] - Replace use of strerror with thread-safe alternatives strerror_r / strerror_l.
* [MESOS-3595] - Framework process hangs after master failover when number frameworks > libprocess thread pool size
* [MESOS-3718] - Implement Quota support in allocator
* [MESOS-3773] - RegistryClientTest.SimpleGetBlob is flaky
* [MESOS-3799] - Compilation warning with Ubuntu wily: auto_ptr is deprecated
* [MESOS-3809] - Expose advertise_ip and advertise_port as command line options in mesos slave
* [MESOS-3817] - Rename offers to outstanding offers
* [MESOS-3832] - Scheduler HTTP API does not redirect to leading master
* [MESOS-3834] - slave upgrade framework checkpoint incompatibility
* [MESOS-3851] - Investigate recent crashes in Command Executor
* [MESOS-3859] - Add github support to apply-reviews.py.
* [MESOS-3860] - Add support for `stout/process.hpp` on Windows.
* [MESOS-3868] - Make apply-review.sh use apply-reviews.py
* [MESOS-3909] - isolator module headers depend on picojson headers
* [MESOS-3916] - MasterMaintenanceTest.InverseOffersFilters is flaky
* [MESOS-3939] - ubsan error in net::IP::create(sockaddr const&): misaligned address
* [MESOS-3963] - Move "using mesos::fetcher::FetcherInfo" into internal namespace in "fetcher.hpp"
* [MESOS-3965] - Ensure resources in `QuotaInfo` protobuf do not contain `role`
* [MESOS-4002] - ReservationEndpointsTest.UnreserveAvailableAndOfferedResources is flaky
* [MESOS-4024] - HealthCheckTest.CheckCommandTimeout is flaky.
* [MESOS-4031] - slave crashed in cgroupstatistics()
* [MESOS-4047] - MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery is flaky
* [MESOS-4067] - ReservationTest.ACLMultipleOperations is flaky
* [MESOS-4069] - libevent_ssl_socket assertion fails
* [MESOS-4072] - The lt-mesos-master will coredump in some situation.
* [MESOS-4102] - Quota doesn't allocate resources on slave joining.
* [MESOS-4107] - `os::strerror_r` breaks the Windows build
* [MESOS-4108] - Implement `os::mkdtemp` for Windows
* [MESOS-4109] - HTTPConnectionTest.ClosingResponse is flaky
* [MESOS-4110] - Implement `WindowsError` to correspond with `ErrnoError`.
* [MESOS-4154] - Rename shutdown_frameworks to teardown_frameworks
* [MESOS-4177] - Create a user doc for Executor HTTP API
* [MESOS-4184] - Jenkins builds for Centos fail with missing 'which' utility and incorrect 'java.home'
* [MESOS-4192] - Add documentation for API Versioning
* [MESOS-4193] - Port `process/file.hpp`
* [MESOS-4202] - Race in SSL socket shutdown
* [MESOS-4218] - Test for Quota Status Endpoint
* [MESOS-4266] - S3 URIs prefixed with / by fetcher
* [MESOS-4274] - libprocess build fail with libhttp-parser >= 2.0
* [MESOS-4275] - Duration uses fixed-width types inconsistently
* [MESOS-4281] - Correctly handle disk quota usage when volumes are bind mounted into the container.
* [MESOS-4283] - Accept 3-field version of HDFS du output
* [MESOS-4290] - Reject tasks with images with filesystem/posix isolator
* [MESOS-4293] - Updated master help message for acls.
* [MESOS-4294] - Protobuf parse should support parsing JSON object containing JSON Null.
* [MESOS-4310] - Disable support for --switch-user on Windows.
* [MESOS-4311] - Protobuf parse should pass error messages when parsing nested JSON.
* [MESOS-4328] - Docker container REST API /monitor/statistics.json output have no timestamp field
* [MESOS-4347] - GMock warning in ReservationTest.ACLMultipleOperations
* [MESOS-4348] - GMock warning in HookTest.VerifySlaveRunTaskHook, HookTest.VerifySlaveTaskStatusDecorator
* [MESOS-4349] - GMock warning in SlaveTest.ContainerUpdatedBeforeTaskReachesExecutor
* [MESOS-4357] - GMock warning in RoleTest.ImplicitRoleStaticReservation
* [MESOS-4375] - Allow schemes in HDFS URI fetcher plugin to be configurable.
* [MESOS-4409] - MasterTest.MaxCompletedFrameworksFlag is flaky
* [MESOS-4411] - Traverse all roles for quota allocation.
* [MESOS-4417] - Prevent allocator from crashing on successful recovery.
* [MESOS-4425] - Introduce filtering test abstractions for HTTP events to libprocess
* [MESOS-4449] - SegFault on agent during executor startup
* [MESOS-4507] - Replace busybox image with alpine in Docker tests
* [MESOS-4515] - ContainerLoggerTest.LOGROTATE_RotateInSandbox breaks when running on Centos6.
* [MESOS-4530] - NetClsIsolatorTest.ROOT_CGROUPS_NetClsIsolate is flaky
* [MESOS-4533] - DiskUsageCollectorTest.ExcludeRelativePath fails on Linux
* [MESOS-4534] - Resources object can be mutated through the public API
* [MESOS-4535] - Logrotate ContainerLogger may not handle FD ownership correctly
* [MESOS-4539] - Exclude paths in Posix disk isolator should be absolute paths.
** Documentation
* [MESOS-3581] - License headers show up all over doxygen documentation.
* [MESOS-3936] - Document possible task state transitions for framework authors
* [MESOS-3996] - libprocess: document when, why defer() is necessary
* [MESOS-4204] - Document that frameworks that participate in a role should cooperate
* [MESOS-4206] - Write new logging-related documentation
* [MESOS-4207] - Add an example bug due to a lack of defer() to the defer() documentation
* [MESOS-4209] - Document "how to program with dynamic reservations and persistent volumes"
* [MESOS-4314] - Publish Quota Documentation
* [MESOS-4396] - Adding Tachyon to the list of frameworks
** Improvement
* [MESOS-313] - Report executor terminations to framework schedulers.
* [MESOS-920] - Set GLOG_drop_log_memory=false in environment prior to logging initialization.
* [MESOS-2275] - Document header include rules in style guide
* [MESOS-2353] - Improve performance of the state.json endpoint for large clusters.
* [MESOS-3074] - Add capacity heuristic for quota requests in Master
* [MESOS-3232] - Implement HTTP Basic Authentication for Mesos endpoints
* [MESOS-3493] - benchmark for declining offers
* [MESOS-3720] - Tests for Quota support in master
* [MESOS-3827] - Improve compilation speed of GMock tests
* [MESOS-3960] - Standardize quota endpoints
* [MESOS-3979] - Replace `QuotaInfo` with `Quota` in allocator interface
* [MESOS-4020] - Introduce filter for non-revocable resources in `Resources`
* [MESOS-4021] - Remove quota from Registry for quota remove request
* [MESOS-4056] - Respond with `MethodNotAllowed` if a request uses an unsupported method.
* [MESOS-4058] - Do not use `Resource.role` for resources in quota request.
* [MESOS-4085] - Implement implicit roles
* [MESOS-4103] - Show disk usage and allocation in WebUI
* [MESOS-4128] - Refactor sorter factories in allocator and improve comments around them.
* [MESOS-4136] - Add a ContainerLogger module that restrains log sizes
* [MESOS-4183] - Move operator<< definitions to .cpp files and include <iosfwd> in .hpp where possible.
* [MESOS-4195] - Add dynamic reservation tests with no principal
* [MESOS-4231] - Add a new category to cpplint to detect missing white-space in comments
* [MESOS-4241] - Consolidate docker store slave flags
* [MESOS-4262] - Enable net_cls subsytem in cgroup infrastructure
* [MESOS-4277] - Provide constexpr Duration::min() and max()
* [MESOS-4302] - Offer filter timeouts are ignored if the allocator is slow or backlogged.
* [MESOS-4337] - Implement a simple Windows version of dirent.hpp, for compatibility.
* [MESOS-4351] - Remove logic around checkpointing in the slave
* [MESOS-4410] - Introduce protobuf for quota set request.
* [MESOS-4505] - Hierarchical allocator performance is slow due to Quota
* [MESOS-4578] - docker run -c is deprecated
** Task
* [MESOS-2079] - IO.Write test is flaky on OS X 10.10.
* [MESOS-2210] - Disallow special characters in role.
* [MESOS-2296] - Implement the Events stream on slave for Call endpoint
* [MESOS-2315] - Deprecate / Remove CommandInfo::ContainerInfo
* [MESOS-2455] - Add operator endpoints to create/destroy persistent volumes.
* [MESOS-3515] - Support Subscribe Call for HTTP based Executors
* [MESOS-3550] - Create a Executor Library based on the new Executor HTTP API
* [MESOS-3615] - Port slave/state.cpp
* [MESOS-3627] - Port process/pid.hpp to Windows
* [MESOS-3628] - Port process/address.hpp to Windows
* [MESOS-3629] - Port stout/ip.hpp to Windows
* [MESOS-3630] - Port stout/net.hpp to Windows
* [MESOS-3631] - Implement stout/windows/net.hpp
* [MESOS-3633] - Port stout/path.hpp to Windows
* [MESOS-3640] - Implement stout/os/windows/ls.hpp
* [MESOS-3645] - Implement stout/os/windows/stat.hpp
* [MESOS-3658] - Port stout/protobuf.hpp to Windows
* [MESOS-3659] - Port slave/paths.hpp to Windows
* [MESOS-3660] - Port slave/state.hpp to Windows
* [MESOS-3693] - Port stout/os/open.hpp to Windows
* [MESOS-3861] - Authenticate quota requests
* [MESOS-3862] - Authorize set quota requests.
* [MESOS-3864] - Simplify and/or document the libprocess initialization synchronization logic
* [MESOS-3882] - Libprocess: Implement process::Clock::finalize
* [MESOS-3911] - Add a `--force` flag to disable sanity check in quota
* [MESOS-3912] - Rescind offers in order to satisfy quota
* [MESOS-3925] - Add HDFS based URI fetcher plugin.
* [MESOS-3951] - Make HDFS tool wrappers asynchronous.
* [MESOS-3981] - Implement recovery in the Hierarchical allocator
* [MESOS-3983] - Tests for quota request validation
* [MESOS-3984] - Tests for quota support in `allocate()` function.
* [MESOS-3985] - Tests for rescinding offers for quota
* [MESOS-4013] - Introduce status endpoint for quota
* [MESOS-4014] - Introduce remove endpoint for quota
* [MESOS-4064] - Add ContainerInfo to internal Task protobuf.
* [MESOS-4081] - Authorize quota removal
* [MESOS-4087] - Introduce a module for logging executor/task output
* [MESOS-4088] - Modularize existing plain-file logging for executor/task logs launched with the Mesos Containerizer
* [MESOS-4116] - Add tests for quotas + empty roles (no registered frameworks)
* [MESOS-4137] - Modularize plain-file logging for executor/task logs launched with the Docker Containerizer
* [MESOS-4150] - Implement container logger module metadata recovery
* [MESOS-4220] - Introduce result_of with C++14 semantics to stout.
* [MESOS-4221] - Invoke _Deferred's implicit conversion operator explicitly.
* [MESOS-4228] - Use std::is_bind_expression to reroute the result of std::bind.
* [MESOS-4236] - Create a design document for jsonify
* [MESOS-4237] - Introduce `jsonify` to stout.
* [MESOS-4238] - Update `Master::Http::state` to use the `jsonify` facility.
* [MESOS-4239] - Update relevant libprocess components to support the `jsonify` facility.
* [MESOS-4240] - Pull provisioner from linux filesystem isolator to Mesos containerizer.
* [MESOS-4378] - Add Source to Resource.DiskInfo.
* [MESOS-4380] - Adjust Resource arithmetics for DiskInfo.Source.
* [MESOS-4400] - Create persistent volume directories based on DiskInfo.Source.
* [MESOS-4402] - Update filesystem isolators to look for persistent volume directories from the correct location.
* [MESOS-4403] - Check paths in DiskInfo.Source.Path exist during slave initialization.
* [MESOS-4415] - Implement stout/os/windows/rmdir.hpp
* [MESOS-4506] - Posix disk isolator should ignore disk quota enforcement for MOUNT type disk resources.
* [MESOS-4526] - Include the allocated portion of reserved resources in the role sorter for DRF.
* [MESOS-4527] - Include allocated portion of the reserved resources in the quota role sorter for DRF.
* [MESOS-4528] - Account for reserved resources in the quota guarantee check.
* [MESOS-4529] - Update the allocator to not offer unreserved resources beyond quota.
** Wish
* [MESOS-3962] - Add labels to the message Port
Release Notes - Mesos - Version 0.26.0
--------------------------------------
** API Changes:
* [MESOS-3560] - Fix JSON-based credential files by changing protobuf `Credential` field `secret` from bytes to string.
* [MESOS-3824] - Add /frameworks endpoint to master.
** Bug
* [MESOS-1867] - Precision errors in UI.
* [MESOS-2864] - Master should not change the state of a terminal task if it receives another terminal update.
* [MESOS-3030] - Build failure on OS 10.11 using Xcode 7.
* [MESOS-3280] - Master fails to access replicated log after network partition.
* [MESOS-3293] - Failing ROOT_ tests on CentOS 7.1 - LimitedCpuIsolatorTest.
* [MESOS-3326] - Make use of C++11 atomics.
* [MESOS-3329] - Unused hashmap::existsValue functions have incomplete code paths.
* [MESOS-3411] - ReservationEndpointsTest.AvailableResources appears to be faulty.
* [MESOS-3428] - Support running filesystem isolation with Command Executor in MesosContainerizer.
* [MESOS-3470] - UserCgroupIsolatorTest failed on CentOS 6.6.
* [MESOS-3501] - Configure cannot find libevent headers in CentOS 6.
* [MESOS-3506] - Build instructions for CentOS 6.6 should include `sudo yum update`.
* [MESOS-3517] - Building mesos from source fails when OS language is not English.
* [MESOS-3519] - Fix file descriptor leakage / double close in the code base.
* [MESOS-3522] - MesosScheduler declineOffer results in an acceptOffer.
* [MESOS-3552] - CHECK failure due to floating point precision on reservation request.
* [MESOS-3553] - LIBPROCESS_IP not passed when executor's environment is specified.
* [MESOS-3560] - JSON-based credential files do not work correctly.
* [MESOS-3563] - Revocable task CPU shows as zero in /state.json.
* [MESOS-3569] - Typos in Mesos Monitoring doc page.
* [MESOS-3584] - Rename libprocess tests to "libprocess-tests".
* [MESOS-3591] - mesos-slave: --help output for "--master" is incomplete.
* [MESOS-3594] - Rename http_api_tests.cpp to scheduler_http_api_tests.cpp.
* [MESOS-3597] - Running tests with CMake are annoying and have a bad reporting story.
* [MESOS-3600] - Unable to build with non-default protobuf.
* [MESOS-3602] - hdfs du fails due to prepended / on path.
* [MESOS-3603] - Test build failure due to comparison between signed and unsigned integers.
* [MESOS-3604] - ExamplesTest.PersistentVolumeFramework does not work in OS X El Capitan.
* [MESOS-3605] - hdfs.du() fails on os x due to lack of native-hadoop library.
* [MESOS-3694] - Enable building mesos.apache.org locally in a Docker container.
* [MESOS-3698] - JSON parsing allows non-whitespace trailing characters.
* [MESOS-3700] - Deprecate resource_monitoring_interval flag.
* [MESOS-3708] - Improve process::subprocess ABORT message.
* [MESOS-3715] - Enable Request resource using Call::REQUEST in scheduler driver.
* [MESOS-3716] - Update Allocator interface to support quota.
* [MESOS-3728] - Libprocess: Flaky behavior on test suite when finalizing.
* [MESOS-3733] - ContentType/SchedulerTest.Suppress/0 is flaky.
* [MESOS-3734] - Incorrect sed syntax for Mac OSX.
* [MESOS-3738] - Mesos health check is invoked incorrectly when Mesos slave is within the docker container.
* [MESOS-3743] - Provide diagnostic output in agent log when fetching fails.
* [MESOS-3748] - HTTP scheduler library does not gracefully parse invalid resource identifiers.
* [MESOS-3751] - MESOS_NATIVE_JAVA_LIBRARY not set on MesosContainerize tasks with --executor_environmnent_variables.
* [MESOS-3769] - Agent logs are misleading during agent shutdown.
* [MESOS-3770] - SlaveRecoveryTest/0.RecoverCompletedExecutor is flaky.
* [MESOS-3771] - Mesos JSON API creates invalid JSON due to lack of binary data / non-ASCII handling.
* [MESOS-3773] - RegistryClientTest.SimpleGetBlob is flaky.
* [MESOS-3793] - Cannot start mesos local on a Debian GNU/Linux 8 docker machine.
* [MESOS-3800] - Containerizer attempts to create Linux launcher by default.
* [MESOS-3806] - 'mount --make-rslave /' does not work as expected on ubuntu 14.04.
* [MESOS-3810] - Must be able to use NetworkInfo with mesos-executor.
* [MESOS-3822] - Cannot specify multiple masters when slave start up.
* [MESOS-3834] - Slave upgrade framework checkpoint incompatibility.
* [MESOS-3837] - Rootfs in provisioner test doesn't handle symlink directories properly.
* [MESOS-3840] - Build broken: 'adding 'bool' to a string does not append to the string' in filesystem tests.
* [MESOS-3847] - Root tests for LinuxFilesystemIsolatorTest are broken.
* [MESOS-3849] - Corrected style in Makefiles.
* [MESOS-3937] - Test DockerContainerizerTest.ROOT_DOCKER_Launch_Executor fails.
* [MESOS-3953] - DockerTest.ROOT_DOCKER_CheckPortResource fails.
* [MESOS-3964] - LimitedCpuIsolatorTest.ROOT_CGROUPS_Cfs and LimitedCpuIsolatorTest.ROOT_CGROUPS_Cfs_Big_Quota fail on Debian 8.
* [MESOS-3966] - LinuxFilesystemIsolatorTest.ROOT_ImageInVolumeWithRootFilesystem fails on Centos 7.1.
* [MESOS-3969] - Failing 'make distcheck' on Debian 8, somehow SSL-related.
* [MESOS-3974] - CgroupsAnyHierarchyMemoryPressureTest tests fail on CentOS 6.7.
* [MESOS-3975] - SSL build of mesos causes flaky testsuite.
* [MESOS-3989] - Add missing DiscoveryInfo field to v1/mesos.proto.
* [MESOS-4106] - The health checker may fail to inform the executor to kill an unhealthy task after max_consecutive_failures.
** Documentation
* [MESOS-2783] - Document the fetcher.
* [MESOS-3692] - Clarify error message 'could not chown work directory'.
* [MESOS-3749] - Configuration docs are missing --enable-libevent and --enable-ssl.
* [MESOS-3752] - CentOS 6 dependency install fails at Maven.
* [MESOS-3905] - Five new docker-related slave flags are not covered by the configuration documentation.
** Improvement
* [MESOS-1841] - Mesos components should expose their version on an endpoint.
* [MESOS-2035] - Add reason to containerizer proto Termination.
* [MESOS-2273] - Add "tests" target to Makefile for building-but-not-running tests.
* [MESOS-2467] - Allow --resources flag to take JSON.
* [MESOS-2613] - Change docker rm command.
* [MESOS-2924] - Allow simple construction via initializer list on hashset.
* [MESOS-2960] - Configure DiscoveryInfo and Visibility per port.
* [MESOS-2972] - Serialize Docker image spec as protobuf.
* [MESOS-3099] - Validation of Docker Image Manifests from Docker Registry.
* [MESOS-3366] - Allow resources/attributes discovery.
* [MESOS-3417] - Log source address replicated log received broadcasts.
* [MESOS-3429] - Allow HTTP response codes in libprocess to be matched.
* [MESOS-3468] - Improve apply_reviews.sh script to apply chain of reviews.
* [MESOS-3554] - Allocator changes trigger large re-compiles.
* [MESOS-3566] - Add a section to the Scheduler HTTP API docs around RecordIO specification.
* [MESOS-3721] - We need the active flag on frameworks in the /state-summary endpoint.
* [MESOS-3735] - Mesos master should expose the version of registered agents.
* [MESOS-3759] - Document messages.proto.
* [MESOS-3788] - Clarify NetworkInfo semantics for IP addresses and group policies.
* [MESOS-3819] - Add documentation explaining "roles".
* [MESOS-4015] - Expose task / executor health in master & slave state.json.
** Task
* [MESOS-1832] - Slave should accept PingSlaveMessage but not "PING" message.
* [MESOS-2224] - Add explanatory comments for Allocator interface.
* [MESOS-2295] - Implement the Call endpoint on Slave.
* [MESOS-2906] - Slave : Synchronous Validation for Calls.
* [MESOS-3104] - Add an endpoint that exposes component flags.
* [MESOS-3129] - Move all MesosContainerizer related files under src/slave/containerizer/mesos.
* [MESOS-3332] - Support HTTP Pipelining in libprocess (http::post).
* [MESOS-3405] - Add JSON::protobuf for google::protobuf::RepeatedPtrField.
* [MESOS-3407] - Mesos fetcher automatically extract gz files.
* [MESOS-3480] - Refactor Executor struct in Slave to handle HTTP based executors.
* [MESOS-3762] - Refactor SSLTest fixture such that MesosTest can use the same helpers.
* [MESOS-3824] - Add /frameworks endpoint to master.
* [MESOS-3845] - Send TaskStatus::container_status inside reconciliation updates.
* [MESOS-3900] - Enable mesos-reviewbot project on jenkins to use docker.
Release Notes - Mesos - Version 0.25.0
--------------------------------------
This release contains:
* [MESOS-1474] - Experimental support for maintenance primitives. Please refer
to maintenance.md for more information.
* [MESOS-2600] - Added master endpoints /reserve and /unreserve for dynamic
reservations. Please refer to reservation.md for more
information.
* [MESOS-2044] - Extended Module APIs to enable IP per container assignment,
isolation and resolution.
** API Changes
* [MESOS-3037] - Add a SUPPRESS call to the scheduler.
** Bug
* [MESOS-2635] - Web UI Display Bug when starting lots of tasks with small cpu value.
* [MESOS-2986] - Docker version output is not compatible with Mesos.
* [MESOS-3046] - Stout's UUID re-seeds a new random generator during each call to UUID::random.
* [MESOS-3051] - performance issues with port ranges comparison.
* [MESOS-3052] - Allocator performance issue when using a large number of filters.
* [MESOS-3136] - COMMAND health checks with Marathon 0.10.0 are broken.
* [MESOS-3169] - FrameworkInfo should only be updated if the re-registration is valid.
* [MESOS-3185] - Refactor Subprocess logic in linux/perf.cpp to use common subroutine.
* [MESOS-3239] - Refactor master HTTP endpoints help messages such that they cannot be out of sync.
* [MESOS-3245] - The comments of DRFSorter::dirty is not correct.
* [MESOS-3254] - Cgroup CHECK fails test harness.
* [MESOS-3258] - Remove Frameworkinfo capabilities on re-registration.
* [MESOS-3261] - Move QoS plug-ins to a specified folder like resource_estimator.
* [MESOS-3269] - The comments of Master::updateSlave() is not correct.
* [MESOS-3282] - Web UI no longer shows Tasks information.
* [MESOS-3344] - Add more comments for strings::internal::fmt.
* [MESOS-3351] - duplicated slave id in master after master failover.
* [MESOS-3387] - Refactor MesosContainerizer to accept namespace dynamically.
* [MESOS-3408] - Labels field of FrameworkInfo should be added into v1 mesos.proto.
* [MESOS-3411] - ReservationEndpointsTest.AvailableResources appears to be faulty.
* [MESOS-3423] - Perf event isolator stops performing sampling if a single timeout occurs.
* [MESOS-3426] - process::collect and process::await do not perform discard propagation.
* [MESOS-3430] - LinuxFilesystemIsolatorTest.ROOT_PersistentVolumeWithoutRootFilesystem fails on CentOS 7.1.
* [MESOS-3450] - Update Mesos C++ Style Guide for namespace usage.
* [MESOS-3451] - Failing tests after changes to Isolator/MesosContainerizer API.
* [MESOS-3458] - Segfault when accepting or declining inverse offers.
* [MESOS-3474] - ExamplesTest.{TestFramework, JavaFramework, PythonFramework} failed on CentOS 6.
* [MESOS-3489] - Add support for exposing Accept/Decline responses for inverse offers.
* [MESOS-3490] - Mesos UI fails to represent JSON entities.
* [MESOS-3512] - Don't retry close() on EINTR.
* [MESOS-3513] - Cgroups Test Filters aborts tests on Centos 6.6.
* [MESOS-3519] - Fix file descriptor leakage / double close in the code base.
* [MESOS-3538] - CgroupsNoHierarchyTest.ROOT_CGROUPS_NOHIERARCHY_MountUnmountHierarchy test is flaky.
* [MESOS-3575] - V1 API java/python protos are not generated.
** Documentation
* [MESOS-2083] - Add documentation for maintenance primitives.
* [MESOS-2466] - Write documentation for all the LIBPROCESS_* environment variables.
* [MESOS-3230] - Create a HTTP based Authentication design doc.
* [MESOS-3492] - Expose maintenance user doc via the documentation home page.
* [MESOS-3508] - Update docs for Agent's --launcher flag.
* [MESOS-3516] - Add user doc for networking support in Mesos 0.25.0.
** Improvement
* [MESOS-2719] - Deprecating '.json' extension in master endpoints urls.
* [MESOS-2757] - Add -> operator for Option<T>, Try<T>, Result<T>, Future<T>.
* [MESOS-2875] - Add containerId to ResourceUsage to enable QoS controller to target a container.
* [MESOS-2964] - libprocess io does not support peek().
* [MESOS-2983] - Deprecating '.json' extension in slave endpoints url.
* [MESOS-2984] - Deprecating '.json' extension in files endpoints url.
* [MESOS-3037] - Add a SUPPRESS call to the scheduler.
* [MESOS-3187] - Docker cli option support.
* [MESOS-3304] - Remove remnants of LIBPROCESS_STATISTICS_WINDOW.
* [MESOS-3312] - Factor out JSON to repeated protobuf conversion.
* [MESOS-3340] - Command-line flags should take precedence over OS Env variables.
* [MESOS-3347] - Remove dead code in src/linux/perf.cpp.
* [MESOS-3377] - mesos docker container with container_name as ENV variable.
* [MESOS-3457] - Add flag to disable hostname lookup.
** Task
* [MESOS-1831] - Master should send PingSlaveMessage instead of "PING".
* [MESOS-1935] - Replace hard-coded reap interval with a constant.
* [MESOS-2061] - Add InverseOffer protobuf message.
* [MESOS-2062] - Add InverseOffer to Event/Call API.
* [MESOS-2066] - Add optional 'Unavailability' to resource offers to provide maintenance awareness.
* [MESOS-2067] - Add HTTP API to the master for maintenance operations.
* [MESOS-2600] - Add /reserve and /unreserve endpoints on the master for dynamic reservation.
* [MESOS-2907] - Agent : Create Basic Functionality to handle /call endpoint.
* [MESOS-3015] - Add hooks for Slave exits.
* [MESOS-3038] - Resource offers do not contain Unavailability, given a maintenance schedule.
* [MESOS-3042] - Master/Allocator does not send InverseOffers to resources to be maintained.
* [MESOS-3043] - Master does not handle InverseOffers in the Accept call (Event/Call API).
* [MESOS-3045] - Maintenance information is not populated in case of failover.
* [MESOS-3066] - Replicated registry needs a representation of maintenance schedules.
* [MESOS-3069] - Registry operations do not exist for manipulating maintanence schedules.
* [MESOS-3217] - Replace boost unordered_{set,map} and hash with std versions.
* [MESOS-3223] - Implement token manager for docker registry.
* [MESOS-3265] - Starting maintenance needs to deactivate agents and kill tasks.
* [MESOS-3266] - Stopping/Completing maintenance needs to reactivate agents.
* [MESOS-3299] - Add a protobuf to represent time with integer precision.
* [MESOS-3310] - Support provisioning images specified in volumes.
* [MESOS-3345] - Expand the range of integer precision when converting into/out of json.
* [MESOS-3346] - Add filter support for inverse offers.
* [MESOS-3375] - Add executor protobuf to v1.
* [MESOS-3395] - In CMake build system, download third party dependencies from a "trusted channel" instead of from Mesos GitHub mirror.
* [MESOS-3419] - Add HELP message for reserve/unreserve endpoint.
* [MESOS-3425] - Modify LinuxLauncher to support Systemd.
* [MESOS-3459] - Change /machine/up and /machine/down endpoints to take an array.
* [MESOS-3510] - Synchronize V1 helper functions with pre-v1.
* Work In Progress:
* Functionality for endpoint 'api/v1/executor' introduced on 'Agent' is incomplete.
Release Notes - Mesos - Version 0.24.1
--------------------------------------
* This is a bug fix release.
** Bug
* [MESOS-2986] - Docker version output is not compatible with Mesos
* [MESOS-3136] - COMMAND health checks with Marathon 0.10.0 are broken
Release Notes - Mesos - Version 0.24.0
--------------------------------------
This release contains experimental v1 scheduler HTTP API. This allows framework schedulers
to send HTTP requests to master endpoint ('/api/v1/scheduler') without the need for a driver.
The release also includes these features:
* [MESOS-336] - Mesos slave should cache executors
* API Changes:
* [MESOS-2293] - Implement the scheduler endpoint on master
* [MESOS-3135] - Publish MasterInfo to ZK using JSON
* Binary API Changes (e.g., new flags)
* [MESOS-3154] - Enable Mesos Agent Node to use arbitrary script / module to figure out IP, HOSTNAME
* [MESOS-809] - External control of the ip that Mesos components publish to zookeeper
* Deprecations:
* [MESOS-2736] - MasterInfo `ip`, `port` and `hostname` are deprecated in
favor of using the `address` field (see `Address` protobuf)
* Work In Progress:
* Support for 'Image' field added to 'Volume' and 'ContainerInfo' protobufs is incomplete.
This release also includes several bug fixes and stability improvements.
** Bug
* [MESOS-2166] - PerfEventIsolatorTest.ROOT_CGROUPS_Sample requires 'perf' to be installed
* [MESOS-2337] - __init__.py not getting installed in $PREFIX/lib/pythonX.Y/site-packages/mesos
* [MESOS-2480] - Protobuf jar is required for unbundled protobuf regardless of --disable-java flag.
* [MESOS-2493] - google glog link is incorrect
* [MESOS-2497] - Create synchronous validations for Calls
* [MESOS-2552] - C++ Scheduler library should send HTTP Calls to master
* [MESOS-2559] - Do not use RunTaskMessage.framework_id.
* [MESOS-2660] - ROOT_CGROUPS_Listen and ROOT_IncreaseRSS tests are flaky
* [MESOS-2862] - mesos-fetcher won't fetch uris which begin with a " "
* [MESOS-2868] - --attributes flag in slave cannot take a value with ':'
* [MESOS-2882] - Duplicate name-value env-vars in '-e' option of docker run
* [MESOS-2900] - Display capabilities in state.json
* [MESOS-2989] - Changing to "framework" from "framwork"
* [MESOS-3001] - Create a "demo" HTTP API client
* [MESOS-3002] - Rename Option<T>::get(const T& _t) to getOrElse() broke network isolator
* [MESOS-3027] - Compiler warning in stout subcommand tests
* [MESOS-3058] - Cgroup tests relies on cgroups::get() returning in a specific order
* [MESOS-3079] - `sudo make distcheck` fails on Ubuntu 14.04 (and possibly other OSes too)
* [MESOS-3121] - Always disable SSLV2
* [MESOS-3124] - Updating persistent volumes after slave restart is problematic.
* [MESOS-3138] - PersistentVolumeTest.SlaveRecovery test fails on OSX
* [MESOS-3141] - Compiler warning when mocking function type has an enum return type.
* [MESOS-3143] - Disable endpoints rule fails to recognize HTTP path delegates
* [MESOS-3148] - Resolve issue with hanging tests with Zookeeper
* [MESOS-3168] - MesosZooKeeperTest fixture can have side effects across tests
* [MESOS-3170] - 0.23 Build fails when compiling against -lsasl2 which has been statically linked
* [MESOS-3175] - subprocess_tests.cpp:598 delete used but allocated with new[]
* [MESOS-3178] - Perform a self bind mount of rootfs itself in fs::chroot::enter.
* [MESOS-3192] - ContainerInfo::Image::AppC::id should be optional
* [MESOS-3195] - Fix master metrics for scheduler calls
* [MESOS-3197] - MemIsolatorTest/{0,1}.MemUsage fails on OS X
* [MESOS-3201] - Libev handle_async can deadlock with run_in_event_loop
* [MESOS-3203] - MasterAuthorizationTest.DuplicateRegistration test is flaky
* [MESOS-3204] - PortMappingIsolatorProcess shell script can silently fail
* [MESOS-3207] - C++ style guide is not rendered correctly (code section syntax disregarded)
* [MESOS-3209] - parameterize allocator benchmark by framework count
* [MESOS-3234] - enable automake maintainer mode
* [MESOS-3237] - HTTP requests with nested path are not properly handled by libprocess
* [MESOS-3238] - Master endpoint help message is incorrect
* [MESOS-3260] - SchedulerTest.* are broken on OSX and CentOS
* [MESOS-3262] - HTTPTest.NestedGet is flaky
* [MESOS-3263] - SchedulerTask.KillTest fails for JSON Requests
* [MESOS-3267] - JSON serialization/deserialization of bytes is incorrect
* [MESOS-3274] - Build error with port mapping isolator
* [MESOS-3275] - ContentType/HttpApiTest.UpdatePidToHttpSchedulerWithoutForce is flaky
* [MESOS-3284] - JSON representation of Protobuf should use base64 encoding for 'bytes' fields.
* [MESOS-3287] - downloadWithHadoop tries to access Error() for a valid Try<bool>
* [MESOS-3290] - Master should drop HTTP calls when it's recovering
** Documentation
* [MESOS-1838] - Add documentation for Authentication
* [MESOS-2555] - Document issue with slave recovery when using systemd.
* [MESOS-3087] - Typos in oversubscription doc
* [MESOS-3167] - Design doc for versioning the HTTP API
* [MESOS-3278] - Add the revocable metrics information in monitoring doc
* [MESOS-3281] - Create a user doc for Scheduler HTTP API
* [MESOS-3286] - Revocable metrics information are missed for slave node
** Improvement
* [MESOS-2350] - Add support for MesosContainerizerLaunch to chroot to a specified path
* [MESOS-2794] - Implement filesystem isolators
* [MESOS-2795] - Introduce filesystem provisioner abstraction
* [MESOS-2798] - Export statistics on "unevictable" memory
* [MESOS-2800] - Rename Option<T>::get(const T& _t) to getOrElse() and refactor the original function
* [MESOS-2841] - FrameworkInfo should include a Labels field to support arbitrary, lightweight metadata
* [MESOS-2880] - Add Frameworkinfo.capabilities on framework re-registration
* [MESOS-2902] - Enable Mesos to use arbitrary script / module to figure out IP, HOSTNAME
* [MESOS-2924] - Allow simple construction via initializer list on hashset.
* [MESOS-2946] - Authorizer Module: Interface design
* [MESOS-2947] - Authorizer Module: Implementation, Integration & Tests
* [MESOS-2951] - Inefficient container usage collection
* [MESOS-2965] - Add implicit cast to string operator to Path.
* [MESOS-2967] - Missing doxygen documentation for libprocess socket interface
* [MESOS-3020] - Expose major, minor and patch components from stout Version
* [MESOS-3054] - update gitignore
* [MESOS-3093] - Support HTTPS requests in libprocess
* [MESOS-3112] - Fetcher should perform cache eviction based on cache file usage patterns.
* [MESOS-3118] - Remove pthread specific code from Stout
* [MESOS-3119] - Remove pthread specific code from Libprocess
* [MESOS-3120] - Remove pthread specific code from Mesos
* [MESOS-3127] - Improve task reconciliation documentation.
* [MESOS-3173] - Mark Path::basename, Path::dirname as const functions.
* [MESOS-3182] - Make Master::registerFramework() and Master::reregisterFramework() call into Master::subscribe()
** Story
* [MESOS-2860] - Create the basic infrastructure to handle /scheduler endpoint
* [MESOS-3142] - As a Developer I want a better way to run shell commands
* [MESOS-3211] - As a Python developer I want a simple way to obtain information about Master from ZooKeeper
* [MESOS-3212] - As a Java developer I want a simple way to obtain information about Master from ZooKeeper
** Task
* [MESOS-2294] - Implement the Events stream on master for Call endpoint
* [MESOS-2640] - Remove old frameworks and ec2 scripts from core Mesos repository
* [MESOS-2910] - Add an Event message handler to scheduler driver
* [MESOS-2913] - Scheduler driver should send Call messages to the master
* [MESOS-2933] - Pass slave's total resources to the ResourceEstimator and QoSController via Slave::usage().
* [MESOS-2961] - Add cpuacct subsystem utils to cgroups
* [MESOS-3012] - Support existing message passing optimization with Event/Call.
* [MESOS-3067] - Implement a streaming response decoder for events stream
* [MESOS-3088] - Update scheduler driver to send SUBSCRIBE call
* [MESOS-3089] - Update scheduler library to send REQUEST call
* [MESOS-3101] - Standardize separation of Windows/Linux-specific OS code
* [MESOS-3102] - Separate OS-specific code in the stout library
* [MESOS-3130] - Custom isolators should implement Isolator instead of IsolatorProcess.
* [MESOS-3131] - Master should send heartbeats on the subscription connection
* [MESOS-3132] - Allow slave to forward messages through the master for HTTP schedulers.
* [MESOS-3145] - Using a unresolvable hostname crashes the framework on registration
* [MESOS-3149] - Use setuptools to install python cli package
* [MESOS-3162] - Provide a means to check http connection equality for streaming connections.
* [MESOS-3179] - Create a test abstraction for preparing test rootfs.
* [MESOS-3194] - Implement a 'read-only' AppC Image Store
** Wish
* [MESOS-3276] - Add Scrapinghub to the Powered By Mesos page
Release Notes - Mesos - Version 0.23.1
--------------------------------------
* This is a bug fix release.
** Bug
* [MESOS-2986] - Docker version output is not compatible with Mesos
* [MESOS-3136] - COMMAND health checks with Marathon 0.10.0 are broken
Release Notes - Mesos - Version 0.23.0
--------------------------------------
This release contains new features:
* [MESOS-1585] - Per-container network isolation: bandwidth capping and unique
egress flow to reduce buffer bloat. Refer to the network
monitoring and isolation documentation for more information.
* [MESOS-2115] - Dockerized slaves will properly recover Docker containers upon failover.
Plus an upgrade to the minimum required compiler versions:
* [MESOS-2604] - Upgrade minimum required compilers to GCC 4.8+ or clang 3.5+.
And experimental support for the following features:
* [MESOS-336] - Fetcher Caching of executor/task binaries. Refer to the fetcher
documentation for more information.
* [MESOS-354] - Support for launching tasks/executors on revocable resources.
These resources can be revoked by Mesos at any time, causing the
tasks using them to be throttled or preempted.
* [MESOS-910] - SSL encryption via libevent. Refer to the SSL documentation for
instructions on building and enabling SSL.
* [MESOS-1554] - Frameworks can create Persistent Volumes from disk resources.
Refer to the persistent volume documentation for more information.
* [MESOS-2018] - Frameworks can dynamically reserve resources for their role.
Refer to the reservation documentation for more information.
This release also includes API changes, new modules, and deprecations.
* Binary API Changes (e.g. new flags):
* [MESOS-1913] - Create libevent/SSL-backed Socket implementation
* [MESOS-2110] - Configurable Ping Timeouts
* [MESOS-2155] - Make docker containerizer killing orphan containers optional
* [MESOS-2832] - Enable configuring Mesos with environment variables without
having them leak to tasks launched
* Framework API Changes:
* [MESOS-1127] - Implement the protobufs for the scheduler API
* [MESOS-2097] - Update Resource protobuf with DiskInfo.
* [MESOS-2191] - Add ContainerId to the TaskStatus message
* [MESOS-2292] - Implement Call/Event protobufs for Executor
* [MESOS-2475] - Add the Resource::ReservationInfo protobuf message.
* [MESOS-2614] - Update name, hostname, failover_timeout, and webui_url in
master on framework re-registration
* [MESOS-2654] - A new 'capabilities' field has been added to FrameworkInfo to
opt in to revocable resources.
* [MESOS-2691] - Update Resource message to include revocable resources.
* [MESOS-2955] - Introduce acceptOffers scheduler driver API for performing
operations on Offers
* [MESOS-2957] - Add version to MasterInfo
* Web UI Changes:
* [MESOS-2104] - Correct naming of cgroup memory statistics
* [MESOS-2485] - Added master metrics for slave removal reasons.
* [MESOS-2620] - Implement a mechanism which allows access control of endpoints
* [MESOS-2743] - Include ExecutorInfos for custom executors in master/state.json
* [MESOS-2775] - Added slave metrics for revocable resources.
* [MESOS-2776] - Added master metrics for revocable resources.
* Module API Changes:
* [MESOS-2050] - Revise Authenticator interface
* [MESOS-2351] - Enable label and environment decorators (hooks) to remove
label and environment entries
* [MESOS-2884] - Allow isolators to specify required namespaces
* New Module/Hook interfaces:
* [MESOS-2160] - Add support for allocator modules
* [MESOS-2650] - Modularize the Resource Estimator
* Deprecations:
* [MESOS-2058] - Remove stats.json endpoints for Master and Slave
* [MESOS-2697] - '/master/shutdown' endpoint is deprecated in favor of
the new '/master/teardown' endpoint.
This release also includes several bug fixes and stability improvements.
** Bug
* [MESOS-328] - HTTP headers should be considered case-insensitive.
* [MESOS-719] - missing-call-to-setgroups
* [MESOS-757] - The post-reviews.py script hangs if HTTP authentication has expired
* [MESOS-1303] - ExamplesTest.{TestFramework, NoExecutorFramework} flaky
* [MESOS-1690] - Expose metric for container destroy failures
* [MESOS-1795] - Assertion failure in state abstraction crashes JVM
* [MESOS-1825] - Support the webui over HTTPS.
* [MESOS-2016] - docker_name_prefix is too generic
* [MESOS-2020] - mesos should send docker failure messages to scheduler
* [MESOS-2161] - AbstractState JNI check fails for Marathon framework
* [MESOS-2165] - When cyrus sasl MD5 isn't installed configure passes,
tests fail without any output
* [MESOS-2183] - docker containerizer doesn't work when mesos-slave is
running in a container
* [MESOS-2199] - Failing test: SlaveTest.ROOT_RunTaskWithCommandInfoWithUser