deads2k
6a4d5cd7cc
start the apimachinery repo
2017-01-11 09:09:48 -05:00
Wojciech Tyczynski
d31ff83fdc
Fix bug of delivering random parts of events
2016-12-22 20:03:38 +01:00
Wojciech Tyczynski
d5e235c831
Reduce timeout for waiting for resource version
2016-12-20 10:05:38 +01:00
Wojciech Tyczynski
457c9a2e6e
Reduce amount of allocations in cacher
2016-12-19 13:51:07 +01:00
Chao Xu
7e787b144a
fix leaking goroutine issues in watch cache
2016-12-12 21:41:33 -08:00
Wojciech Tyczynski
01699ef320
Proper fix for non-receiving watchers
2016-12-09 09:43:10 +01:00
Clayton Coleman
3454a8d52c
refactor: update bazel, codec, and gofmt
2016-12-03 19:10:53 -05:00
Clayton Coleman
5df8cc39c9
refactor: generated
2016-12-03 19:10:46 -05:00
Wojciech Tyczynski
ec247315be
Handle RV in Get calls to storage interface.
2016-12-03 10:18:43 +01:00
Kubernetes Submit Queue
cd560926bd
Merge pull request #36889 from wojtek-t/reuse_fields_and_labels
...
Automatic merge from submit-queue
Reuse fields and labels
This should significantly reduce memory allocations in apiserver in large cluster.
Explanation:
- every kubelet is refreshing watch every 5-10 minutes (this generally is not causing relist - it just renews watch)
- that means, in 5000-node cluster, we are issuing ~10 watches per second
- since we don't have "watch heartbets", the watch is issued from previously received resourceVersion
- to make some assumption, let's assume pods are evenly spread across pods, and writes for them are evenly spread - that means, that a given kubelet is interested in 1 per 5000 pod changes
- with that assumption, each watch, has to process 2500 (on average) previous watch events
- for each of such even, we are currently computing fields.
This PR is fixing this problem.
2016-12-02 21:49:43 -08:00
Wojciech Tyczynski
36e6cd19e1
Cache fields for filtering in watchCache.
2016-11-29 09:48:09 +01:00
Wojciech Tyczynski
ac7b1065e7
Better waiting for watch event delivery in cacher
2016-11-28 09:25:33 +01:00
Chao Xu
4f3d0e3bde
more dependencies packages:
...
pkg/metrics
pkg/credentialprovider
pkg/security
pkg/securitycontext
pkg/serviceaccount
pkg/storage
pkg/fieldpath
2016-11-23 15:53:09 -08:00
Kubernetes Submit Queue
6f80ec91d6
Merge pull request #35415 from wojtek-t/avoid_get
...
Automatic merge from submit-queue
Try to avoid Get to etcd in GuaranteedUpdate in Cacher
2016-10-26 16:15:06 -07:00
Wojciech Tyczynski
5d2062db9f
Reduce amount of not-helping logs in apiserver
2016-10-26 13:20:07 +02:00
Wojciech Tyczynski
a1090151ef
Try to avoid Get to etcd in GuaranteedUpdate in Cacher
2016-10-25 21:59:02 +02:00
Wojciech Tyczynski
93c008f8a4
Support resourceVersion in GetToList - unify interface of List and GetToList
2016-10-21 10:09:23 +02:00
Kubernetes Submit Queue
5fcb9fd056
Merge pull request #35125 from wojtek-t/avoid_unnecessary_reallocations
...
Automatic merge from submit-queue
Avoid unnecessary reallocations of slice in Cacher
2016-10-19 20:33:13 -07:00
Wojciech Tyczynski
0ced3f43bf
Avoid unnecessary reallocations of slice in Cacher
2016-10-19 19:33:33 +02:00
Wojciech Tyczynski
8040719d7f
Avoid computing key func multiple times in cacher
2016-10-19 08:38:18 +02:00
Wojciech Tyczynski
f10b0205e7
Store keys in watchCache store
2016-10-19 08:38:18 +02:00
Wojciech Tyczynski
9895f337ee
Avoid unnecessary copies in cacher
2016-10-19 08:33:58 +02:00
Wojciech Tyczynski
0f2270698c
Reduce amount of annoying logs in cacher
2016-10-17 16:15:24 +02:00
Wojciech Tyczynski
4d5ac91f88
Add tracing to listing in Cacher
2016-10-17 08:58:40 +02:00
Wojciech Tyczynski
2298e1746c
Increase buffer sizes in cacher for watchers interested in all/many objects.
2016-10-13 16:40:33 +02:00
Wojciech Tyczynski
c02df26ad6
Improve some logging in cacher
2016-10-07 15:04:08 +02:00
Wojciech Tyczynski
90bc19959d
Extend logging in cacher to understand its bottleneck
2016-10-06 10:57:46 +02:00
Hongchao Deng
6f3ac807fd
pass SelectionPredicate instead of Filter to storage layer
2016-09-26 09:47:19 -07:00
Lucas Käldström
06917531b3
Move HighWaterMark to the top of the struct in order to fix arm, second time
2016-09-23 20:58:28 +03:00
Wojciech Tyczynski
e5b3f19638
Fix logging in cacher
2016-09-14 09:13:41 +02:00
Wojciech Tyczynski
949dd90593
Extend logging for performance debuggin
2016-09-12 12:46:19 +02:00
Wojciech Tyczynski
03a23aed09
Log water mark for incoming queue in cacher
2016-09-09 11:35:05 +02:00
Kubernetes Submit Queue
504ccc6f37
Merge pull request #32275 from wojtek-t/split_process_event
...
Automatic merge from submit-queue
Split dispatching to watchers in Cacher into separate goroutine.
Should help with #32257
2016-09-08 07:42:12 -07:00
Wojciech Tyczynski
e750454c31
Fix allow for non-ready nodes in e2e framework
2016-09-08 14:22:08 +02:00
Wojciech Tyczynski
378cd81dbe
Split dispatching to watchers in Cacher into separate goroutine.
2016-09-08 13:27:54 +02:00
Wojciech Tyczynski
bd54c389f5
Extend logging for scalability tests debugging
2016-09-08 12:02:59 +02:00
Hongchao Deng
a607a69f4a
pkg/storage: cleanup Codec() from interface
2016-08-15 20:46:13 -07:00
Kubernetes Submit Queue
a69054f9c3
Merge pull request #30368 from wojtek-t/log_terminating_all_watchers
...
Automatic merge from submit-queue
Log warning when terminating all watchers
Ref #30275
<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg " height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30368 )
<!-- Reviewable:end -->
2016-08-10 09:26:07 -07:00
Wojciech Tyczynski
497f891cfb
Log warning when terminating all watchers
2016-08-10 17:04:10 +02:00
Hongchao Deng
7f28eda9be
storage interface: remove Backends()
2016-08-07 16:10:18 -07:00
Wojciech Tyczynski
33e612e101
Revert "cacher.go: embed storage.Interface into cacher"
2016-07-22 07:28:45 +02:00
Xiang Li
44c0a1190c
cacher.go: embed storage.Interface into cacher
2016-07-16 23:25:48 -07:00
Jordan Liggitt
4fcd999c25
Fix watch cache filtering
2016-07-14 13:13:17 -04:00
Wojciech Tyczynski
1d9bc58328
Extend Filter interface with Trigger() and use it for pods and nodes
2016-07-13 08:45:18 +02:00
Wojciech Tyczynski
7f7ef0879f
Change filter to interface in storage.Interface
2016-07-13 08:44:22 +02:00
Xiang Li
aa472ff734
cacher: replace usable lock with conditional variable
2016-07-04 08:57:59 -07:00
David McMahon
ef0c9f0c5b
Remove "All rights reserved" from all the headers.
2016-06-29 17:47:36 -07:00
k8s-merge-robot
00b5b548d6
Merge pull request #26854 from xiang90/cacher
...
Automatic merge from submit-queue
cacher.go: remove NewCacher func
NewCacher is a wrapper of NewCacherFromConfig. NewCacher understands
how to create a key func from scopeStrategy. However, it is not the
responsibility of cacher. So we should remove this function, and
construct the config in its caller, which should understand scopeStrategy.
2016-06-25 11:10:06 -07:00
Xiang Li
c530a5810a
cacher: remove unnecessary initialzation
2016-06-04 22:49:45 -07:00
Xiang Li
e2aab093aa
cacher.go: remove NewCacher func
...
NewCacher is a wrapper of NewCacherFromConfig. NewCacher understands
how to create a key func from scopeStrategy. However, it is not the
responsibility of cacher. So we should remove this function, and
construct the config in its caller, which should understand scopeStrategy.
2016-06-04 22:46:58 -07:00
